-- Logs begin at Wed 2021-07-28 10:00:44 UTC, end at Wed 2021-07-28 11:00:37 UTC. -- Jul 28 10:28:43.391060 dv-cinder-800431-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 10:28:43.398667 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 10:28:43 2021] *** Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: nodename: dv-cinder-800431-3-iscsi Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: machine: x86_64 Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: clock source: unix Jul 28 10:28:43.400647 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: pcre jit disabled Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: detected number of CPU cores: 4 Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: current working directory: / Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: detected binary path: /usr/bin/uwsgi-core Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: your processes number limit is 47680 Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: your memory page size is 4096 bytes Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: detected max file descriptor number: 2048 Jul 28 10:28:43.401112 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: lock engine: pthread robust mutexes Jul 28 10:28:43.403123 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: thunder lock: enabled Jul 28 10:28:43.403123 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 10:28:43.403123 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 10:28:43.446766 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: Python main interpreter initialized at 0x55f619d5d9c0 Jul 28 10:28:43.446766 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: python threads support enabled Jul 28 10:28:43.446766 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: your server socket listen backlog is limited to 100 connections Jul 28 10:28:43.446766 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: your mercy for graceful operations on workers is 90 seconds Jul 28 10:28:43.447141 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 10:28:43.447218 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: *** Operational MODE: preforking *** Jul 28 10:28:43.447433 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: *** uWSGI is running in multiple interpreter mode *** Jul 28 10:28:43.447433 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: spawned uWSGI master process (pid: 92538) Jul 28 10:28:43.447634 dv-cinder-800431-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 10:28:43.448435 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: spawned uWSGI worker 1 (pid: 92539, cores: 1) Jul 28 10:28:43.448538 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: spawned uWSGI worker 2 (pid: 92540, cores: 1) Jul 28 10:28:43.448711 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 10:28:45.093483 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:28:45.093483 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: from cryptography.utils import int_from_bytes Jul 28 10:28:45.094146 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:28:45.094146 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: from cryptography.utils import int_from_bytes Jul 28 10:28:45.095295 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:28:45.095295 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: from cryptography.utils import int_from_bytes Jul 28 10:28:45.095779 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:28:45.095779 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: from cryptography.utils import int_from_bytes Jul 28 10:28:47.793695 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:28:47.794295 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:28:47.794387 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:28:47.794752 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:28:47.795007 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:28:47.795394 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.795717 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.795946 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:28:47.796311 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.796415 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:28:47.796483 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.796658 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.796785 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:28:47.796996 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.797084 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:28:47.797292 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:28:47.797378 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.797624 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.797718 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.797952 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798037 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798214 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798299 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798527 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798625 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798855 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-3-iscsi {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.798949 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.799179 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.799272 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.799490 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.799582 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.799802 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.799887 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.800120 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.800212 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.800414 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.800500 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.800734 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.800838 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.801064 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.801159 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-3-iscsi {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.801922 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.802084 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.803275 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.803420 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.803548 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.803711 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.803845 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.803969 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804089 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804213 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804342 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804468 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804598 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804732 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.804945 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805087 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805229 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805353 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805465 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805591 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805714 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805836 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.805966 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806090 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-3-iscsi {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806220 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806343 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806466 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806589 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806719 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806849 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.806979 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807109 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807244 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807368 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807497 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807627 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807750 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-3-iscsi {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.807881 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.808005 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.808135 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.808540 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.808686 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.808836 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.808974 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809098 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809235 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809423 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809551 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809681 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809804 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.809926 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.810057 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.810249 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.810377 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.810564 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.810692 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.810895 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811034 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811205 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811339 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811513 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811648 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811785 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.811908 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.812038 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.812167 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.812364 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.812502 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.812686 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.812835 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813038 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813180 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813312 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813436 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813643 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813781 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.813905 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814028 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814149 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814280 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814432 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814561 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814739 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.814866 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815044 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815180 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815349 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815477 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815607 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815739 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.815924 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.816060 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.816233 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.816359 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.816537 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.816672 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.817447 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.817582 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.817760 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.817888 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818074 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818199 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818385 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818528 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818719 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818844 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.818995 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.819122 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.819305 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.819439 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.819628 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.819755 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.819945 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.820079 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.820271 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.820396 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.820579 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.820703 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.820927 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821068 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821247 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821373 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821555 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821681 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821860 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.821996 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.822165 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.822291 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.822485 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.822618 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.822811 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.822944 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823111 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823243 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823372 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823495 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823647 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823774 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.823952 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.824092 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.824271 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.824396 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.824576 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.824710 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.824907 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825036 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825213 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825350 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825514 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825649 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825818 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.825953 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.826125 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.826252 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.826428 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.826565 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.826734 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.826860 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827039 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827167 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827341 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827469 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827646 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827779 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.827949 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.828088 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.828254 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.828382 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.828560 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.828699 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.828960 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829106 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829238 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829362 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829482 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829603 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829781 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.829917 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.830084 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.830209 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.830391 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.830516 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.830701 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.830834 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831005 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831131 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831320 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831452 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831624 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831761 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.831928 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.832060 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.832235 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.832368 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.832564 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.832708 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.832922 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.833111 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.833249 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.833442 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.833570 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.833749 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.833877 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834058 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834185 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834378 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834506 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834685 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834813 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.834990 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.835117 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.835294 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.835421 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.835600 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.835736 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.835905 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836033 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836211 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836352 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836512 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836653 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836841 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.836967 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.837137 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.837274 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.837443 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.837575 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.837752 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.837880 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838059 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838193 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838364 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838490 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838666 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838793 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.838971 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.839122 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.839291 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.839389 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.839614 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.839708 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.839923 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.840020 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.840231 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.840317 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.840539 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.840625 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.840886 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:28:47.840976 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.841224 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.841316 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.841536 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.841619 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.841851 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.841945 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.842194 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.842278 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.842493 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.842587 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.842803 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.842898 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.843115 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.843200 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.843433 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.843527 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.843751 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.843836 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.844081 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.844166 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.844398 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.844494 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.844713 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.844819 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.845054 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.845165 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.845369 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.845476 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.845684 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.845769 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846015 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846100 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846335 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846433 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846645 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846729 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.846972 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.847114 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.847289 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.847429 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.847607 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.847734 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.847934 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.848062 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.848849 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.848998 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.849275 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.849410 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.849535 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.849657 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.849789 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.849914 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.850091 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.850219 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.850411 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.850539 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.850723 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.850852 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851032 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851161 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851367 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851487 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851682 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851811 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.851995 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.852121 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.852314 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.852453 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.852608 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.852737 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.852946 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.853082 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.853254 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.853383 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.853562 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.853690 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.853882 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854009 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854196 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854335 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854501 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854635 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854811 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.854945 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.855125 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.855261 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.855434 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.855562 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.855745 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.855873 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.856052 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.856189 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.856364 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.856493 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.856673 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.856843 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857008 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857146 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857325 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857451 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857633 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857760 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.857938 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858074 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858253 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858388 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858557 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858690 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858850 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.858985 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.859164 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.859370 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.859504 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.859628 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.859767 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.859892 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.860073 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.860200 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.860410 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.860541 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.860696 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.860844 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861033 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861192 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861345 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861483 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861663 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861793 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.861978 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.862105 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.862300 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.862454 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.862615 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.862742 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.862930 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.863088 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.863234 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.863371 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.863544 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.863679 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.864396 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.864596 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.864734 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.864994 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865136 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865262 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865385 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865515 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865647 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865780 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.865934 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866071 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866237 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866364 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866542 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866679 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866847 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.866976 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.867170 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.867298 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.867478 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.867608 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.867780 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.867908 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.868084 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.868213 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.868388 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.868525 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.868707 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.868854 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869052 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869180 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869370 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869481 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869680 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869780 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.869992 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.870078 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.870301 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.870390 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.870610 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.870694 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.870913 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871011 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871218 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871304 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871528 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871631 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871853 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.871964 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.872156 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.872241 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.872466 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.872575 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.872793 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.872906 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.873104 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.873197 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.873417 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.873502 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.873748 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.873844 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.874062 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.874224 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.874365 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.874760 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.874910 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875055 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875225 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875370 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875516 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875660 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875829 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.875974 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.876134 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.876278 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.876438 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.876590 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.876778 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.876924 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877062 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877199 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877372 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877518 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877668 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877806 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.877976 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.878128 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.878288 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.878433 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.878581 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.878730 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.878890 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879041 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879179 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879315 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879550 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879702 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879840 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.879982 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.880119 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.880264 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.880432 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.880578 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.880727 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.880929 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881077 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881224 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881363 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881506 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881672 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881825 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.881986 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.882138 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.882275 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.882411 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.882580 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.882734 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.882873 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883019 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883219 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883362 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883530 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883675 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883823 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.883970 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.884139 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.884285 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.884445 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.884588 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.884772 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.884920 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.885089 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.885248 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.885465 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.885607 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.885754 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.885894 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886037 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886175 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886312 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886456 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886602 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886752 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.886889 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887025 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887189 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887335 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887482 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887620 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887791 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.887934 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.888104 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.888264 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.888405 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.888542 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.888696 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.888877 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889027 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889175 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889314 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889457 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889617 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889762 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.889935 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.890088 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.890273 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.890502 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.890663 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.890837 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.890982 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.891153 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.891299 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.891472 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.891617 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.891791 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.891943 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.892108 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.892360 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.892505 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.892699 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.892873 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893046 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893142 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893370 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893457 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893678 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893764 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.893986 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894083 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894295 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894383 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894619 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894712 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894912 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.894998 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.895240 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.895332 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.895546 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.895764 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.895865 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.896086 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.896179 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.896402 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.896488 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.896722 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.896831 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897049 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897134 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897358 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897451 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897660 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897745 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.897969 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898055 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898276 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898361 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898583 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898682 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898894 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.898979 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.899193 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.899277 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.899503 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.899590 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.899807 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.899913 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.900121 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.900214 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.900432 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.900519 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.900773 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.900862 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.901096 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.901194 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.901404 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.901490 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.901713 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.901807 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902031 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902122 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902343 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902437 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902649 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902735 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.902955 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903046 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903259 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903360 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903569 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903662 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903877 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.903964 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.904180 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.904270 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.904497 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.904586 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.904832 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.904936 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.905147 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.905234 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.905455 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.905540 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.905758 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.905851 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906069 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906154 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906371 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906454 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906683 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906777 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.906991 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.907077 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.907296 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.907394 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.907599 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.907691 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.907906 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908000 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908211 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908296 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908516 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908620 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908843 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.908941 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.909147 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.909233 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.909473 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.909605 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.909761 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.909854 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.910068 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.910153 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.910373 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.910459 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.911206 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.911311 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.911515 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.911678 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.911819 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.911992 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.912143 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.912318 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.912452 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.912634 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.912766 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.912979 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.913073 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.913291 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.913385 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.913608 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.913693 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.913924 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914010 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914236 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914322 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914571 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914656 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914872 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.914959 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.915181 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.915266 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.915484 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.915568 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.915788 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.915874 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.916092 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.916177 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.916397 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.916488 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.916700 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.916818 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917028 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917114 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917333 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917428 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917636 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917720 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.917938 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918025 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918247 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918411 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918557 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918644 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918858 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.918941 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.919159 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.919257 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.919461 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.919546 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.919765 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.919856 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.920073 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.920213 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.920383 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.920470 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.920711 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.920852 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921049 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921153 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921356 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921441 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921664 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921749 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.921970 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922057 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922281 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922365 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922590 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922676 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922906 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.922992 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.923218 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.923309 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.923530 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.923615 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.923836 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.923929 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.924140 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.924224 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.924461 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.924552 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.924789 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.924880 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.925102 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.925187 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.925422 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.925515 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.925739 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.925837 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.926057 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.926142 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.926412 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.926520 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.926721 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.926842 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927026 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927111 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927335 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927430 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927645 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927730 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.927955 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.928040 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.928267 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.928367 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.928577 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.928663 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.928909 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929009 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929220 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929315 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929530 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929616 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929841 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.929928 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.930149 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.930284 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.930458 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.930544 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.930762 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.930846 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931074 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931166 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931380 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931465 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931685 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931769 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.931994 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.932080 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.932296 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.932381 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.932607 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.932691 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.932936 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933032 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933245 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933361 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933577 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933673 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933892 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.933985 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.934203 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.934297 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.934522 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.934616 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.934831 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.934924 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.935146 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.935233 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.935456 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.935558 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.935764 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.935887 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.936185 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.936272 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.936500 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.936602 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.936836 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.936980 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.937150 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.937236 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.937457 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.937551 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.937762 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.937855 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.938074 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.938159 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.938452 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.938548 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.938694 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.938811 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939000 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939132 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939306 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939449 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939629 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939766 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.939940 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.940077 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.940264 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.940396 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.940682 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.940782 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.941022 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.941108 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.941330 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.941424 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.941639 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.941746 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.942470 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.942642 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.942866 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.942953 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.943195 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.943280 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.943527 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.943622 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.943904 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.943989 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.944212 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.944297 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.944528 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.944630 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.944866 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945005 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945193 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945328 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945519 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945647 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945831 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.945980 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.946148 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.946311 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.946455 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.946641 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.946772 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.946953 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.947091 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.947274 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.947405 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.947591 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.947730 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.947921 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.948146 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.948253 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.948471 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.948559 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.948799 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.948907 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.949124 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.949209 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.949453 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.949540 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.949765 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.949851 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950073 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950165 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950386 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950525 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950689 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950881 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.950994 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.951212 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.951320 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.951527 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.951612 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.951853 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.951939 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.952183 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.952270 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.952492 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.952584 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.952829 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.952919 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.953135 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.953221 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.953441 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.953532 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.953750 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.953841 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.954076 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.954163 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.954384 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.954469 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.954703 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.954789 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955016 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955104 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955319 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955403 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955626 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955725 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.955936 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956029 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956238 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956322 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956541 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956633 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956869 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.956968 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.957208 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.957300 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.957560 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.957665 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.957946 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.958032 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.958262 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.958359 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.958592 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.958679 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.958907 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959113 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959204 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959297 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959512 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959599 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959821 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.959915 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.960167 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.960254 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.960478 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.960611 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.960817 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.960924 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.961131 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.961223 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.961444 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.961530 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.961752 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.961838 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962058 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962143 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962365 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962451 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962676 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962807 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.962981 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963074 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963284 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963370 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963588 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963717 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963910 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.963997 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.964214 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.964307 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.964539 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.964633 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.964925 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.965035 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.965178 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.965274 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.965483 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.965620 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.965786 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.966003 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.966126 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.966381 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.966468 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.966700 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.966785 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967031 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967117 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967346 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967433 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967675 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967761 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.967985 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.968071 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.968294 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.968380 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.968605 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.968694 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.968937 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969041 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969252 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969338 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969568 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969657 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969889 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.969983 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.970204 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.970289 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.970517 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.970603 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.970828 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.970923 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.971142 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.971228 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.971457 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.971550 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.971773 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.971872 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.972093 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.972292 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.972413 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.972620 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.972737 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.972961 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.973580 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.973930 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974066 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974257 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974361 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974579 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974667 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974896 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.974982 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.975209 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.975303 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.975521 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.975607 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.975835 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.976048 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.976134 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.976386 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.976473 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.976708 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.976898 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.977055 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.977156 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.977377 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.977465 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.977703 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.977790 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978020 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978114 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978339 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978432 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978657 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978744 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.978975 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.979069 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.979293 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.979380 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.979620 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.979741 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.979942 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.980029 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.980267 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.980353 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.980594 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.980679 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.980941 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981031 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981257 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981342 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981572 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981657 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981890 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.981984 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.982208 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.982301 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.982521 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.982616 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.982836 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.982929 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.983150 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.983236 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.983480 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.983574 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.983806 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.983889 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.984122 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.984206 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.984438 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.984525 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.984795 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.984883 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.985093 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.985190 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.985415 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.985615 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.985735 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.985929 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.986054 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.986264 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.986359 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.986593 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.986680 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.986922 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987015 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987239 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987333 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987559 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987645 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987891 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.987983 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.988205 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.988291 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.988513 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.989365 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.989460 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.989732 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.989914 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990004 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990091 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990316 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990403 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990635 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990734 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.990943 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.991030 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.991263 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.991348 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.991577 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.991671 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.991910 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.992111 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.992223 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.992459 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.992558 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.992801 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.992896 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.993133 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.993219 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.993462 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.993564 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.993782 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.993867 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.994089 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.994174 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.994412 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.994505 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.994719 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.994803 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.995027 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.995268 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.995356 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.995620 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.995707 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.995944 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.996030 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.996277 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.996371 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.996610 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.996717 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997030 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997131 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997347 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997442 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997681 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997767 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.997995 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.998089 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.998308 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.998455 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.998629 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.998808 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.998949 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.999159 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.999245 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.999760 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:47.999853 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.000115 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.000202 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.000426 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.000510 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.000736 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.000858 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.001079 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.001166 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.001389 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.001487 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.001717 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.001844 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002030 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002194 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002342 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002547 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002641 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002897 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.002983 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.003251 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.003337 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.003562 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.003649 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.003871 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.003956 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.004182 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.004268 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.004522 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.004853 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.004967 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.005233 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.005331 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.005552 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.005661 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.005871 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.005965 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.006183 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.006277 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.006498 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.006633 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.006806 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.006989 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.007135 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.007346 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.007441 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.007737 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.007824 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.008057 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.008149 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.008373 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.008704 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.008833 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.009046 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.009144 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.009364 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.009450 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.009714 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.009835 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.010036 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.010218 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.010578 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.010673 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.010919 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.011005 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.011244 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.011329 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.011590 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.011684 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.011933 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.012020 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.012247 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.012367 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.012560 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.012739 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.012898 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.013118 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.013228 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.013486 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.013571 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.013849 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.013936 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.014165 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.014412 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.014501 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.014786 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.014882 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.015101 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.015195 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.015508 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.015593 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.015901 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.015988 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.016218 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.016305 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.016533 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.016619 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.016909 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.017017 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.017238 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.017340 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.017559 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.017686 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.017882 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.018042 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.018203 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.018397 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.018520 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.018768 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.018862 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.019137 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.019222 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.019468 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.019720 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.019837 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.020223 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.020339 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.020644 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.020732 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.021044 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.021142 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.021408 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.021496 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.021736 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.021845 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.022071 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.022218 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.022387 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.022586 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.022724 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.022943 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.023066 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.023321 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.023455 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.023716 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.023802 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.024028 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.024127 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.024339 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.024520 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.024649 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.024910 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.025030 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.025275 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.025364 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.025648 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.025732 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.025968 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.026066 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.026296 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.026424 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.026609 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.026808 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.026927 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.027170 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.027278 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.027541 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.027627 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.027853 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.027938 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.028165 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.028251 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.028486 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.028572 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.028820 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.028948 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.029141 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.029304 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.029455 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.029659 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.029782 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.030023 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.030117 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.030378 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.030465 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.030708 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.030792 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.031025 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.031111 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.031337 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.031443 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.031667 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.031799 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.032007 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.032199 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.032325 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.032549 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.032637 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.032934 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.033037 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.033291 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.033377 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.033601 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.033687 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.033929 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034024 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034256 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034341 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034575 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034663 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034888 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.034974 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.035222 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.035308 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.035537 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.036157 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.036375 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.036634 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.036721 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037011 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037112 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037324 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037419 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037637 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037724 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.037966 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038053 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038283 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038379 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038591 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038683 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038908 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.038994 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.039222 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.039316 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.039537 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.039629 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.039851 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.039935 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.040160 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.040247 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.040493 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.040581 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.040827 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.040915 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.041146 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.041234 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.041454 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.041539 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.041764 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.041857 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.042080 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.042173 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.042392 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.042489 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.042715 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.042809 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043030 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043115 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043349 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043435 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043663 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043769 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.043976 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.044071 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.044297 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.044383 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.044616 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.044703 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.044977 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.045068 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.045220 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:28:48.045315 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.045640 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.045972 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.046323 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.046640 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.046988 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.047325 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:28:48.047572 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:28:48.068554 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_db.sqlalchemy.engines [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.070228 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_db.sqlalchemy.engines [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.148185 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.context [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),879bb43f-01c6-4672-bf48-025868d9cf22(cell1) {{(pid=92539) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:28:48.149497 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.context [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),879bb43f-01c6-4672-bf48-025868d9cf22(cell1) {{(pid=92540) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:28:48.152532 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:28:48.153795 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_concurrency.lockutils [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:28:48.154168 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:28:48.155005 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:28:48.155403 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_concurrency.lockutils [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:28:48.156232 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_concurrency.lockutils [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:28:48.156983 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:28:48.158227 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_concurrency.lockutils [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92540) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:28:48.168149 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_db.sqlalchemy.engines [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.171027 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_db.sqlalchemy.engines [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.174919 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_db.sqlalchemy.engines [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.177788 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_db.sqlalchemy.engines [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.532100 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_db.sqlalchemy.engines [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.537309 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG oslo_db.sqlalchemy.engines [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:28:48.883954 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: WARNING keystonemiddleware.auth_token [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:28:48.885977 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: WARNING keystonemiddleware.auth_token [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:28:48.890441 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: WARNING keystonemiddleware.auth_token [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:28:48.892507 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: WARNING keystonemiddleware.auth_token [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:28:49.241429 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: WARNING keystonemiddleware.auth_token [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:28:49.246582 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: WARNING keystonemiddleware.auth_token [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:28:49.250544 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: WARNING keystonemiddleware.auth_token [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:28:49.251986 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f619d5d9c0 pid: 92540 (default app) Jul 28 10:28:49.254117 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:28:49.255389 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001846 Jul 28 10:28:49.256105 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 789 bytes} [Wed Jul 28 10:28:49 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:28:49.256209 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: WARNING keystonemiddleware.auth_token [None req-cb39f6fd-eaad-429f-8857-ea77dafc75a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:28:49.261076 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f619d5d9c0 pid: 92539 (default app) Jul 28 10:30:08.937075 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:08.938068 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 28 10:30:08.938634 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:09.379231 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-31b357eb-baf7-418f-b9a1-acb899d57bbd admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:09.409020 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-31b357eb-baf7-418f-b9a1-acb899d57bbd admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448088 Jul 28 10:30:09.409575 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Jul 28 10:30:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:11.622697 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:11.625086 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-5e5d3691-b2bf-4f63-876b-ed57fa98adf7 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002676 Jul 28 10:30:11.628980 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:11 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:11.704213 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-383fd641-e9ae-4c48-8464-36b39134fd76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "id": "c1", "ram": 256, "name": "cirros256"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:11.733032 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:11.733032 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: warnings.warn(msg) Jul 28 10:30:11.765926 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-383fd641-e9ae-4c48-8464-36b39134fd76 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.132594 Jul 28 10:30:11.766834 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:11 2021] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:12.000736 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-083b9a42-834b-4847-b566-a7ec92caf4a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:12.003594 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:12.003594 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: warnings.warn(msg) Jul 28 10:30:12.072303 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-083b9a42-834b-4847-b566-a7ec92caf4a7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297142 Jul 28 10:30:12.089388 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Jul 28 10:30:11 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:14.297816 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-383fd641-e9ae-4c48-8464-36b39134fd76 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:14.299661 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-383fd641-e9ae-4c48-8464-36b39134fd76 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Jul 28 10:30:14.300070 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:14.415248 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-6ba2bf49-7f47-4885-aa18-570967f19328 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:14.433718 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:14.433718 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: warnings.warn(msg) Jul 28 10:30:14.451629 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-6ba2bf49-7f47-4885-aa18-570967f19328 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140733 Jul 28 10:30:14.452185 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:14.464134 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-5c5d9518-066a-492b-95f4-c5be610b8734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:14.465652 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:30:14.465652 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: warnings.warn(msg) Jul 28 10:30:14.498433 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-5c5d9518-066a-492b-95f4-c5be610b8734 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037915 Jul 28 10:30:14.498924 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Jul 28 10:30:14 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:16.713642 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-6ba2bf49-7f47-4885-aa18-570967f19328 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:16.714665 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-6ba2bf49-7f47-4885-aa18-570967f19328 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 28 10:30:16.715068 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:16.776048 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-1d10d8a1-ebc5-4654-a312-4467d14bd6f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:16.795484 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-1d10d8a1-ebc5-4654-a312-4467d14bd6f0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073225 Jul 28 10:30:16.796386 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:30:16.808775 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-fac750c0-c63f-4cf9-a61b-32d2e9ae2313 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:16.839182 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-fac750c0-c63f-4cf9-a61b-32d2e9ae2313 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034379 Jul 28 10:30:16.840171 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Jul 28 10:30:16 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:19.066857 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-1d10d8a1-ebc5-4654-a312-4467d14bd6f0 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:19.068728 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-1d10d8a1-ebc5-4654-a312-4467d14bd6f0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002499 Jul 28 10:30:19.069564 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:19.146842 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-cdb59a96-ad28-4d1d-834c-d520c7ef387f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "swap": 0}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:19.167251 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-cdb59a96-ad28-4d1d-834c-d520c7ef387f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091315 Jul 28 10:30:19.167909 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:19.180821 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-6e2118ce-4866-4b1a-a700-2c3016b322ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:19.206343 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-6e2118ce-4866-4b1a-a700-2c3016b322ec admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029344 Jul 28 10:30:19.207063 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Jul 28 10:30:19 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:21.427228 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-cdb59a96-ad28-4d1d-834c-d520c7ef387f admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:21.428239 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-cdb59a96-ad28-4d1d-834c-d520c7ef387f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 28 10:30:21.428640 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:21.487641 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-edbc691a-8606-4556-b001-c217da45009b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "id": "d4", "disk": 20}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:21.512022 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-edbc691a-8606-4556-b001-c217da45009b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076653 Jul 28 10:30:21.512893 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:30:21.524553 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-aa639511-9839-46cc-aa34-05ec1260722c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:21.546874 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-aa639511-9839-46cc-aa34-05ec1260722c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025917 Jul 28 10:30:21.557205 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Wed Jul 28 10:30:21 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:23.763118 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-edbc691a-8606-4556-b001-c217da45009b admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.764162 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-edbc691a-8606-4556-b001-c217da45009b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 28 10:30:23.764560 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:23.827401 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-8c46e9cb-5abf-48bd-8f9a-ece463dd840e admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:23.850731 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-8c46e9cb-5abf-48bd-8f9a-ece463dd840e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079355 Jul 28 10:30:23.851195 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Jul 28 10:30:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:30:26.098147 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-edbc691a-8606-4556-b001-c217da45009b admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:26.099170 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-edbc691a-8606-4556-b001-c217da45009b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 28 10:30:26.099572 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:30:26.158329 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-ee170044-495c-4c9b-98e5-878fc7c2ebdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "ram": 512}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.177108 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-ee170044-495c-4c9b-98e5-878fc7c2ebdb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070765 Jul 28 10:30:26.178091 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:26 2021] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:30:26.190468 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-a554c2d9-c8db-4b0e-ae31-56765112cc0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:26.213515 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-a554c2d9-c8db-4b0e-ae31-56765112cc0b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027034 Jul 28 10:30:26.214140 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Jul 28 10:30:26 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:28.440025 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-ee170044-495c-4c9b-98e5-878fc7c2ebdb admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:28.441212 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-ee170044-495c-4c9b-98e5-878fc7c2ebdb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 28 10:30:28.441575 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:28.512903 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-56cf553c-5d78-4ed5-a032-d6ea21c3a399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.531746 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-56cf553c-5d78-4ed5-a032-d6ea21c3a399 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081880 Jul 28 10:30:28.532970 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:28.547018 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-724a2c0e-abd1-41b9-a028-9cc580d415b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:28.575126 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-724a2c0e-abd1-41b9-a028-9cc580d415b4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031595 Jul 28 10:30:28.575942 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Jul 28 10:30:28 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:30.959048 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-56cf553c-5d78-4ed5-a032-d6ea21c3a399 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:30.960032 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-56cf553c-5d78-4ed5-a032-d6ea21c3a399 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 28 10:30:30.960602 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:31.021403 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-87738144-50b4-4ef5-b0fc-af157fd2bdbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:31.043891 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-87738144-50b4-4ef5-b0fc-af157fd2bdbe admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076918 Jul 28 10:30:31.044676 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:30 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:30:31.057869 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-44918a06-ac2d-44ca-85a4-a5a7bedd9ac4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:31.084555 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-44918a06-ac2d-44ca-85a4-a5a7bedd9ac4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030560 Jul 28 10:30:31.085613 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Jul 28 10:30:31 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:30:33.331186 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-87738144-50b4-4ef5-b0fc-af157fd2bdbe admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:33.336551 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-87738144-50b4-4ef5-b0fc-af157fd2bdbe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002703 Jul 28 10:30:33.336551 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:33 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:33.395468 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-b1008328-fdb8-4f36-a8d1-094b8cb5b0ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:33.415859 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-b1008328-fdb8-4f36-a8d1-094b8cb5b0ff admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075617 Jul 28 10:30:33.416410 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:33.428698 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-0bcf0bd3-8fe1-49f5-bb69-949868ab9fc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:33.453755 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-0bcf0bd3-8fe1-49f5-bb69-949868ab9fc8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028661 Jul 28 10:30:33.460097 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Jul 28 10:30:33 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:30:35.691407 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-b1008328-fdb8-4f36-a8d1-094b8cb5b0ff admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:30:35.693145 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-b1008328-fdb8-4f36-a8d1-094b8cb5b0ff admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 Jul 28 10:30:35.693750 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:30:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:30:35.753166 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-c8e72b4a-9b85-401d-84ff-c13f1feb66be admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "swap": 0}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:35.785335 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-c8e72b4a-9b85-401d-84ff-c13f1feb66be admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.085040 Jul 28 10:30:35.793523 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Wed Jul 28 10:30:35 2021] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:30:35.798981 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-00427925-efe6-411f-913e-cb1099314a41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:30:35.832349 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-00427925-efe6-411f-913e-cb1099314a41 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037198 Jul 28 10:30:35.848883 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Wed Jul 28 10:30:35 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:31:16.063286 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-c8e72b4a-9b85-401d-84ff-c13f1feb66be admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:16.064396 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-c8e72b4a-9b85-401d-84ff-c13f1feb66be admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Jul 28 10:31:16.064815 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:31:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:16.120062 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-839c0a3f-abda-4d82-a70a-0879527ca561 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:16.138000 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-839c0a3f-abda-4d82-a70a-0879527ca561 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066847 Jul 28 10:31:16.138526 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Jul 28 10:31:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:17.554602 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-c8e72b4a-9b85-401d-84ff-c13f1feb66be admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:17.555607 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-c8e72b4a-9b85-401d-84ff-c13f1feb66be admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 28 10:31:17.556002 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:17.743408 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-5f639605-a412-44fa-902c-229516d2f459 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:17.749065 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.wsgi [None req-5f639605-a412-44fa-902c-229516d2f459 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 10:31:17.749632 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-5f639605-a412-44fa-902c-229516d2f459 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:31:17.750415 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-5f639605-a412-44fa-902c-229516d2f459 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.055877 Jul 28 10:31:17.750910 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Jul 28 10:31:17 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:31:17.760521 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-9d68a50f-2247-4262-90a0-c82886168363 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:17.782794 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-9d68a50f-2247-4262-90a0-c82886168363 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025741 Jul 28 10:31:17.783270 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Jul 28 10:31:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:17.793289 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-05c8f335-2db8-47e9-bf21-3e17d539bace admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:17.814141 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-05c8f335-2db8-47e9-bf21-3e17d539bace admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024362 Jul 28 10:31:17.814669 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Jul 28 10:31:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:17.824344 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-64b19281-21c9-4fba-a1b4-058124272585 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:17.830337 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.wsgi [None req-64b19281-21c9-4fba-a1b4-058124272585 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 10:31:17.830895 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-64b19281-21c9-4fba-a1b4-058124272585 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:31:17.831667 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-64b19281-21c9-4fba-a1b4-058124272585 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010859 Jul 28 10:31:17.832150 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Jul 28 10:31:17 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:31:19.172046 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-05c8f335-2db8-47e9-bf21-3e17d539bace admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.173131 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-05c8f335-2db8-47e9-bf21-3e17d539bace admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 28 10:31:19.173521 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:19.360649 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-eaa934ba-68d8-4711-a522-5d4a54359649 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.365935 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.wsgi [None req-eaa934ba-68d8-4711-a522-5d4a54359649 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 10:31:19.366497 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-eaa934ba-68d8-4711-a522-5d4a54359649 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:31:19.367279 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-eaa934ba-68d8-4711-a522-5d4a54359649 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.056592 Jul 28 10:31:19.367780 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Jul 28 10:31:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:31:19.378422 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-3bf371c2-2cd8-4a5b-8358-eac4cd91af45 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.392327 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-3bf371c2-2cd8-4a5b-8358-eac4cd91af45 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018330 Jul 28 10:31:19.392789 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Jul 28 10:31:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:19.402397 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-05a3606f-403f-4ab5-8814-ee0f3f405299 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.415734 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-05a3606f-403f-4ab5-8814-ee0f3f405299 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016791 Jul 28 10:31:19.416271 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Jul 28 10:31:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:19.425692 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-243d8061-e81f-4b59-abfc-26b7f757c79d admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:19.430659 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.wsgi [None req-243d8061-e81f-4b59-abfc-26b7f757c79d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 10:31:19.431211 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-243d8061-e81f-4b59-abfc-26b7f757c79d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:31:19.432011 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-243d8061-e81f-4b59-abfc-26b7f757c79d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.009748 Jul 28 10:31:19.432487 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1191 bytes} [Wed Jul 28 10:31:19 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:31:20.772350 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-05a3606f-403f-4ab5-8814-ee0f3f405299 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:20.773385 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-05a3606f-403f-4ab5-8814-ee0f3f405299 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 28 10:31:20.773802 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:20.963329 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-3ece0296-1869-479d-a371-2db256acdeaf admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:20.970634 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.wsgi [None req-3ece0296-1869-479d-a371-2db256acdeaf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 10:31:20.971191 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-3ece0296-1869-479d-a371-2db256acdeaf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:31:20.971970 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-3ece0296-1869-479d-a371-2db256acdeaf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.060346 Jul 28 10:31:20.972453 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Jul 28 10:31:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:31:20.982013 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b3f4bda8-0594-42cb-9e1a-ccf5ce1f2daa admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:20.995729 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b3f4bda8-0594-42cb-9e1a-ccf5ce1f2daa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017212 Jul 28 10:31:20.996243 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Jul 28 10:31:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:21.006124 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:21.019489 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016708 Jul 28 10:31:21.019962 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1211 bytes} [Wed Jul 28 10:31:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:31:21.029432 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-a468dcc6-6de9-4045-9a4f-f157a2c5ce18 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:21.034909 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.wsgi [None req-a468dcc6-6de9-4045-9a4f-f157a2c5ce18 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 10:31:21.035466 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-a468dcc6-6de9-4045-9a4f-f157a2c5ce18 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92540) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:31:21.036241 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-a468dcc6-6de9-4045-9a4f-f157a2c5ce18 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010300 Jul 28 10:31:21.036727 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Jul 28 10:31:21 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 10:31:22.374652 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:22.375669 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Jul 28 10:31:22.376054 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:22.564079 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b1d1287f-9321-46e0-8a42-adfd355a978e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:22.583016 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b1d1287f-9321-46e0-8a42-adfd355a978e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.068433 Jul 28 10:31:22.583621 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Jul 28 10:31:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:23.933559 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:23.934561 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 28 10:31:23.934954 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:24.127254 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-84c55fb8-1872-418b-a0ec-1095fcccf292 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:24.145067 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-84c55fb8-1872-418b-a0ec-1095fcccf292 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.067127 Jul 28 10:31:24.145593 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Jul 28 10:31:24 2021] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:25.494559 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:25.495555 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 28 10:31:25.495943 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:25.689644 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b8b0ecc9-fbda-4b6a-90d5-acd80eea29cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:25.706956 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b8b0ecc9-fbda-4b6a-90d5-acd80eea29cd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.066129 Jul 28 10:31:25.707405 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Jul 28 10:31:25 2021] POST /compute/v2.1/flavors => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:31:27.045210 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:27.046829 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 28 10:31:27.047223 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:27.234671 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-9fcad336-0608-4ac8-a63c-8530be5224c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:31:27.252065 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-9fcad336-0608-4ac8-a63c-8530be5224c5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.066365 Jul 28 10:31:27.252626 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1236 bytes} [Wed Jul 28 10:31:27 2021] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:31:28.624729 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:28.625758 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Jul 28 10:31:28.626155 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:31:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:31:28.811724 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-7143430c-44d5-4c28-bdd1-ed05cde26cd7 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:31:28.831130 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-7143430c-44d5-4c28-bdd1-ed05cde26cd7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.067962 Jul 28 10:31:28.831658 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1203 bytes} [Wed Jul 28 10:31:28 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:15.083723 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:15.084805 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-06fe6976-4597-461e-b578-f1d09138399c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 28 10:32:15.085202 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Wed Jul 28 10:32:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:32:15.141415 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-dd4bc62b-a4ad-4908-a601-7f2d5d987817 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:15.160935 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-dd4bc62b-a4ad-4908-a601-7f2d5d987817 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068488 Jul 28 10:32:15.161454 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Wed Jul 28 10:32:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:32:15.183292 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-bc58347c-f6ed-4d11-9d9d-12279b24c3bb admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:15.191422 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-bc58347c-f6ed-4d11-9d9d-12279b24c3bb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011703 Jul 28 10:32:15.191936 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Jul 28 10:32:15 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:15.203427 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-728f0f37-ddde-4136-b325-c22688c0fadc admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:15.210859 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-728f0f37-ddde-4136-b325-c22688c0fadc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010954 Jul 28 10:32:15.211354 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Jul 28 10:32:15 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:32:15.222967 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-76de8db4-02f9-4882-9af5-556a1e8ae67f admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:15.230410 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-76de8db4-02f9-4882-9af5-556a1e8ae67f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010912 Jul 28 10:32:15.230922 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Wed Jul 28 10:32:15 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:32:15.242271 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:32:15.249874 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010941 Jul 28 10:32:15.250373 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Wed Jul 28 10:32:15 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:33:34.205927 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-c8e04ef5-5dd2-45fb-8b2d-0a06af4d0534 tempest-verify_tempest_config-144171443 tempest-verify_tempest_config-144171443-project] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:33:34.208018 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-c8e04ef5-5dd2-45fb-8b2d-0a06af4d0534 tempest-verify_tempest_config-144171443 tempest-verify_tempest_config-144171443-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107748 Jul 28 10:33:34.208540 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Jul 28 10:33:34 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:35:10.652846 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:10.654546 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jul 28 10:35:10.654936 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:35:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:10.902645 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-f82279ab-79a3-4743-a69c-bfae659e8b7e admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:10.904525 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:35:10.904525 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: warnings.warn(msg) Jul 28 10:35:10.906077 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-f82279ab-79a3-4743-a69c-bfae659e8b7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:10.906519 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-f82279ab-79a3-4743-a69c-bfae659e8b7e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:10.907299 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-f82279ab-79a3-4743-a69c-bfae659e8b7e admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:10.907724 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-f82279ab-79a3-4743-a69c-bfae659e8b7e admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:10.940627 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-f82279ab-79a3-4743-a69c-bfae659e8b7e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.144883 Jul 28 10:35:10.941197 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Jul 28 10:35:10 2021] GET /compute/v2.1/os-services => generated 791 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:35:12.302301 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.303328 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 28 10:35:12.303724 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 37/72] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:35:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:35:12.493418 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-79ea6fee-6583-4f05-9cd9-a326713e27ce admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:12.494702 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:35:12.494702 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: warnings.warn(msg) Jul 28 10:35:12.496231 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-79ea6fee-6583-4f05-9cd9-a326713e27ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:12.497228 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-79ea6fee-6583-4f05-9cd9-a326713e27ce admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:12.498260 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-79ea6fee-6583-4f05-9cd9-a326713e27ce admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:12.498688 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-79ea6fee-6583-4f05-9cd9-a326713e27ce admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:12.523016 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-79ea6fee-6583-4f05-9cd9-a326713e27ce admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.078356 Jul 28 10:35:12.523490 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Jul 28 10:35:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:35:24.294592 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:24.295701 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 28 10:35:24.296093 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 38/74] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:35:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:24.486926 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-67504c10-ec2f-486e-a511-03faf0cff273 admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:24.488107 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:35:24.488107 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: warnings.warn(msg) Jul 28 10:35:24.489938 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-67504c10-ec2f-486e-a511-03faf0cff273 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:24.490381 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-67504c10-ec2f-486e-a511-03faf0cff273 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:24.491201 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-67504c10-ec2f-486e-a511-03faf0cff273 admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:24.491596 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-67504c10-ec2f-486e-a511-03faf0cff273 admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:24.518526 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-67504c10-ec2f-486e-a511-03faf0cff273 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.080244 Jul 28 10:35:24.519031 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 37/75] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Jul 28 10:35:24 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:35:25.898686 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: DEBUG nova.api.openstack.wsgi [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] Calling method '>' {{(pid=92540) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:25.899689 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: INFO nova.api.openstack.requestlog [None req-b6ebf9cf-6cbd-4691-9463-26ff9c0e9793 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 28 10:35:25.900079 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: [pid: 92540|app: 0|req: 39/76] 10.222.0.25 () {56 vars in 1075 bytes} [Wed Jul 28 10:35:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:35:26.087853 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG nova.api.openstack.wsgi [None req-4451a3d5-24d2-4162-ab1c-e115b9aabc8e admin admin] Calling method '>' {{(pid=92539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:35:26.089050 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:35:26.089050 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: warnings.warn(msg) Jul 28 10:35:26.090655 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-4451a3d5-24d2-4162-ab1c-e115b9aabc8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:26.091106 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-4451a3d5-24d2-4162-ab1c-e115b9aabc8e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:26.091939 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-4451a3d5-24d2-4162-ab1c-e115b9aabc8e admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:35:26.092404 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: DEBUG oslo_concurrency.lockutils [None req-4451a3d5-24d2-4162-ab1c-e115b9aabc8e admin admin] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:35:26.113802 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: INFO nova.api.openstack.requestlog [None req-4451a3d5-24d2-4162-ab1c-e115b9aabc8e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.074306 Jul 28 10:35:26.114342 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: [pid: 92539|app: 0|req: 38/77] 10.222.0.25 () {60 vars in 1194 bytes} [Wed Jul 28 10:35:26 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:36:24.549265 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: Wed Jul 28 10:36:24 2021 - graceful shutdown triggered... Jul 28 10:36:24.548983 dv-cinder-800431-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 10:36:24.550202 dv-cinder-800431-3-iscsi devstack@n-api.service[92539]: Gracefully killing worker 1 (pid: 92539)... Jul 28 10:36:24.550679 dv-cinder-800431-3-iscsi devstack@n-api.service[92540]: Gracefully killing worker 2 (pid: 92540)... Jul 28 10:36:25.549985 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: worker 1 buried after 1 seconds Jul 28 10:36:25.549985 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: worker 2 buried after 1 seconds Jul 28 10:36:25.549985 dv-cinder-800431-3-iscsi devstack@n-api.service[92538]: goodbye to uWSGI. Jul 28 10:36:25.551531 dv-cinder-800431-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 10:36:25.552080 dv-cinder-800431-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 10:36:25.554909 dv-cinder-800431-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 10:36:25.564914 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 10:36:25.567568 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 10:36:25 2021] *** Jul 28 10:36:25.567730 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 10:36:25.567865 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: nodename: dv-cinder-800431-3-iscsi Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: machine: x86_64 Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: clock source: unix Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: pcre jit disabled Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: detected number of CPU cores: 4 Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: current working directory: / Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: detected binary path: /usr/bin/uwsgi-core Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: your processes number limit is 47680 Jul 28 10:36:25.567995 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: your memory page size is 4096 bytes Jul 28 10:36:25.568609 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: detected max file descriptor number: 2048 Jul 28 10:36:25.568609 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: lock engine: pthread robust mutexes Jul 28 10:36:25.568609 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: thunder lock: enabled Jul 28 10:36:25.568609 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 10:36:25.568609 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 10:36:25.614662 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: Python main interpreter initialized at 0x55a9914d89c0 Jul 28 10:36:25.614662 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: python threads support enabled Jul 28 10:36:25.614662 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: your server socket listen backlog is limited to 100 connections Jul 28 10:36:25.614662 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: your mercy for graceful operations on workers is 90 seconds Jul 28 10:36:25.615135 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 10:36:25.615135 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: *** Operational MODE: preforking *** Jul 28 10:36:25.615373 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: *** uWSGI is running in multiple interpreter mode *** Jul 28 10:36:25.615373 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: spawned uWSGI master process (pid: 119101) Jul 28 10:36:25.615578 dv-cinder-800431-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 10:36:25.617404 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: spawned uWSGI worker 1 (pid: 119120, cores: 1) Jul 28 10:36:25.617404 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: spawned uWSGI worker 2 (pid: 119121, cores: 1) Jul 28 10:36:25.617404 dv-cinder-800431-3-iscsi devstack@n-api.service[119101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 10:36:27.438607 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:36:27.438607 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: from cryptography.utils import int_from_bytes Jul 28 10:36:27.439298 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:36:27.439298 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: from cryptography.utils import int_from_bytes Jul 28 10:36:27.444423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:36:27.444423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: from cryptography.utils import int_from_bytes Jul 28 10:36:27.444995 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 10:36:27.444995 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: from cryptography.utils import int_from_bytes Jul 28 10:36:29.941153 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:36:29.941687 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:36:29.941951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:36:29.942260 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:36:29.942524 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:36:29.942921 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.943253 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.943579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.943904 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.944236 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.944555 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.944908 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.945233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.945568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.945831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.946150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.946480 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-3-iscsi {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.946806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.947118 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.947552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.947923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.948250 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.948575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.948943 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.949451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.950587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.950587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.950587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.950839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.951131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.951443 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.951765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.952073 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.952411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.952709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.953136 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-3-iscsi {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.953458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.953775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.954092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.954520 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.954816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.955127 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.955452 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.955782 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.956092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.956424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.956828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.957089 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.957674 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.957986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.958301 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.958633 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.958938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.959249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.959558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.959813 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.960125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.960498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.961846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.961846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.961846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.961846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.962352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.962352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.962603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.962782 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.963403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.963634 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.963898 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.964212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.964530 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.964895 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.965228 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.965550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.965876 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.966201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.966494 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.966898 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.967154 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.967472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.967816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.968139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.968452 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.968800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.969127 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.969438 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.969748 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.970058 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.970382 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.970711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.971019 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.971475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.971794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.972105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.972429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.972429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.973065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.973354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.973659 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.974004 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.974276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.974585 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.974897 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.975205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.975521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.975824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.976131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.976438 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.976858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.977105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.977422 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.977731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.978040 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.978350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.979415 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.979902 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.980221 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.980549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.980886 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.981201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.981525 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.981839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.982151 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.982475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.982780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.983089 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.983410 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.983722 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.984030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.984356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.984650 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.984980 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.985313 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.985620 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.985927 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.986231 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.986551 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.986874 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.987185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.987496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.987815 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.988278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:29.988462 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.988822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.989161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.989482 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.989819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.990156 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.990478 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.990794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.991111 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.991441 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.991757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.992072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.992871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.992871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.993216 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.993383 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.993648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.993967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.995070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.995395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.995722 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.996059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.996389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.996706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.997082 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.997430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.998004 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.998337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.998655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.998981 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.999298 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.999615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:29.999929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.000249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.000566 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.000966 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.001242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.001566 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.001885 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.002197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.002548 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.002951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.003272 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.003583 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.003910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.004265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.004578 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.004986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.005254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.005662 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.005850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.006160 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.006479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.006792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.007177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.007427 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.007740 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.008056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.008384 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.008694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.009049 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.009367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.009681 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.010088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.010404 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.010734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.011053 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.011368 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.011707 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.012039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.012350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.012679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.013072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.013406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.013717 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.014031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.014341 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.014649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.014958 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.015305 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.015576 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.015884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.016193 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.016502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.016840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.017169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.017482 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.017796 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.018104 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.018410 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.018752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.019061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.019400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.019716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.020044 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.020364 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.020680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.021014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.021324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.021639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.021967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.022277 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.022591 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.022899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.023211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.023533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.023868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.024180 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.024494 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.024840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.025156 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.025618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.026038 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.026349 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.026659 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.026975 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.027292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.027608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.027922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.028231 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.028547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.028883 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.029194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.029504 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.029819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.030143 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.030454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.030777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.031102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.031411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.031718 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.032044 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.032356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.032661 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.032994 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.033303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.033646 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.033959 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.034266 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.034586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.034909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.035221 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.035608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.035853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.036184 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.036507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.036843 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.037156 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.037473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.037788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.038102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.038415 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.038739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.039051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.039362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.039673 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.039981 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.040292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.040610 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.041941 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.042284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.042609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.042932 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.043256 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.043579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.043729 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 10:36:30.044202 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.044354 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 10:36:30.044509 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.044733 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 10:36:30.044932 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.045084 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 10:36:30.045234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.045386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 10:36:30.045570 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.045864 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.046029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.046181 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.046330 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.046481 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.046623 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.046623 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.046923 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.047078 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.047221 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.047371 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.047519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.047737 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.047956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.048109 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.048253 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.048401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.048544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.048706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.048874 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.049020 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.049173 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.049323 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.049467 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-800431-3-iscsi {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.049622 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.049772 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.049915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.050058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.050212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.050368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.050511 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.050671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.050821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.050963 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.051105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.051256 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.051425 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.051748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.051894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.052044 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.052215 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.052368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.052523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.052678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.052870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.053023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.053182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.053325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.053475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.053618 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.053767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.053909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.054064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.054208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.054350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.054514 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.054663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.054813 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.055015 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.055160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.055302 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.055302 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.055589 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-800431-3-iscsi {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.055746 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.056047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.056194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.056338 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.056510 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.056710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.057376 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.057529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.057690 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.057848 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.058087 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.058245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.058390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.058532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.058674 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.058825 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.058977 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.059139 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.059290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.059290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.059576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.059720 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.059862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.060010 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.060160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.060304 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.060456 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.060672 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.060838 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.060993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.061187 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.061359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.061514 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.061665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.061807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.061955 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.062103 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.062253 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.062408 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.062559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.062719 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.062870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.063023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.063174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.063317 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.063458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.063606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.063758 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.063907 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.064062 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.064204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.064347 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.064543 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.064705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.064914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.065067 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.065217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.065362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.065503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.065643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.065799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.065942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.066240 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.066383 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.066535 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.066677 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.066829 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.066988 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.067138 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.067279 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.067420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.067568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.067724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.067868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.068017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.068243 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.068399 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.068556 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.068699 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.068906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.069070 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.069221 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.069370 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.069526 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.069676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.069819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.069968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.070111 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.070259 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.070484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.070629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.070778 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.070939 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.071082 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.071235 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.071387 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.071530 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.071777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.072060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.072264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.072427 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.072578 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.072722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.072918 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.073065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.073234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.073392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.073541 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.073692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.073834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.074092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.074257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.074411 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.074562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.074562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.074848 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.074998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.075142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.075305 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.075455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.075597 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.075746 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.075902 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.076058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.076360 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.076504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.076645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.076817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.076967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.077118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.077271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.077425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.077568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.077710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.077851 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.078007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.078150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.078387 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.078537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.078679 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.078829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.078981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.079125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.079275 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.079437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.079587 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.079729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.079879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.080023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.080165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.080313 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.080457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.080611 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.080815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.080966 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.081129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.081283 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.081426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.081582 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.081726 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.081868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.082019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.082168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.082320 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.082465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.082607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.082756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.082908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.083059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.083212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.083361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.083512 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.083655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.083811 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.083962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.084112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.084262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.084405 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.084566 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.084718 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.084893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.085038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.085197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.085340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.085497 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.085641 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.085783 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.085933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.086076 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.086236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.086537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.086691 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.086842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.086992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.087135 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.087287 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.087438 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.087581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.087731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.087907 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.088064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.088221 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.088390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.088737 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.088933 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.089090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.089241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.089405 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.089549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.089692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.089834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.089977 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.090133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.090277 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 10:36:30.090419 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.090562 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.090704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.090846 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.090998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.091156 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.091318 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.091462 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.091605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.091755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.091915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092067 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092510 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092662 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.092974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.093128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.093282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.093432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.093584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.093735 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.093879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094173 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094475 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094777 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.094919 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.095080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.095232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.095504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.095653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.095796 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.095944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.096087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.099083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.099266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.099424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.099587 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.099743 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.099896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100349 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100633 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100796 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.100961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.101233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.101399 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.101544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.101686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.101836 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102000 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102295 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102438 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.102882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.103024 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.103165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.103314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.103460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.104151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.104457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.104616 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.104778 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.104927 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105081 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105239 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105542 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.105993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.106150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.106300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.106454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.106617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.106766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.106943 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.107262 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.107423 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.107574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.107732 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.107891 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.108051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.108201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.108359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.108515 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.108664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.108858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.109021 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.109257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.109421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.109580 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.109739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.109888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110046 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110511 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110660 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110819 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.110990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.111141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.111297 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.111447 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.111596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.111762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.111925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.112083 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.112234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.112391 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.112985 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.113168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.113331 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.113491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.113649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.113807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.113958 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.114116 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.114273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.114422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.114571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.114720 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.114884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115035 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115184 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115343 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.115966 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.116124 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.116273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.116428 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.116577 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.116734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.116925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.117102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.117102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.117575 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.117733 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.117896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.118972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.119147 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.119922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.120094 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.120319 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.120491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.120650 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.120820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.120987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.121146 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.121307 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.121458 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.121608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.121771 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.121926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.122076 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.122253 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.122413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.122571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.122978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.123133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.123291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.123442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.123599 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.123749 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.123899 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.124048 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.124048 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.124349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.124511 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.124661 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.124879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125034 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125648 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.125966 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.126126 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.126277 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.126426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.126595 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.126752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.126915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.127065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.127215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.127544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.127706 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.127856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128323 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128323 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128616 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.128972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.129123 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.129271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.129271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.129570 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.129721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.129967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.130197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.130352 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.130501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.130657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.130828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.130978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.131134 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.131285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.131485 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.131641 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.131808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.131962 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132120 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132418 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132567 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132725 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.132922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.133264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.133419 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.133583 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.133583 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.133583 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.134013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.134163 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.134311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.134311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.134603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.134822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.135080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.135277 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.135452 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.135615 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.135766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.135924 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.136075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.136233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.136392 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.136549 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.136706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.136706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.137029 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.137189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.137353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.137534 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.137841 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.137991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.138143 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.138291 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.138450 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.138609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.138768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.138925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139396 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139546 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.139853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.140154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.140395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.140395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.140888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.141054 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.141217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.141376 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.141534 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.141691 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.141851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.142010 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.142010 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.142314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.142471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.142471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.142850 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143458 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143607 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143754 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.143909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.144218 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.144368 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.144368 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.144659 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.144827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.144993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145152 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145152 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145751 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.145914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.146206 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.146354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.146354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.146645 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.146794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.146942 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.147101 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.147101 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.147384 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.147552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.147880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.148041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.148041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.148345 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.148495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.148654 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.148853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149157 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149157 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.149914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.150070 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.150226 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.150377 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.150655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.150828 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.150954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151050 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151143 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151239 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.151953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152066 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152301 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152418 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152543 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.152933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153043 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.153393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154357 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154485 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154614 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154745 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.154982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155090 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155199 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155321 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.155900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156038 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156874 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.156996 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.157105 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.157214 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.157322 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.157505 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.157627 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.157745 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158138 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158247 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.158901 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159020 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159136 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159477 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159598 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159708 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.159933 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160159 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160727 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.160882 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161196 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161479 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.161941 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.162138 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.162257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.162462 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.162589 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.162785 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.162904 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.163102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.163228 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.163418 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.163535 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.163736 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.163863 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.164051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.164177 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.164373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.164496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.164676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.164852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.165017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.165154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.165344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.165470 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.165665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.165784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.166487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.166691 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.166992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.167112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.167316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.167437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.167660 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.167777 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.168083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.168285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.168406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.168613 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.168770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.168961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.169088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.169287 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.169408 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.169596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.169714 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.169912 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.170037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.170248 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.170376 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.170574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.170711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.170903 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171203 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171323 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171515 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171634 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.171955 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.172190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.172333 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.172461 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.172572 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.172741 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.172919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.173076 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.173212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.173402 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.173521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.173716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.173842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174335 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.174968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.175101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.175290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.175420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.175602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.175775 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.175923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.176237 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.176355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.176555 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.176852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.177018 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.177236 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.177407 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.177565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.177865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.178199 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.178375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.178605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.178759 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.178916 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.179134 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.179290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.179468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.179640 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.179800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.179957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.180110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.180270 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.180427 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.180587 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.180769 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.181018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.181184 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.181336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.181495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.181707 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.182370 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.182523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.182679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.182837 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183007 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183310 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183758 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.183915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.184066 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.184216 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.184376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.184533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.184683 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.184899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.185063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.185227 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.185383 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.185540 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.185701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.185851 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186158 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186310 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.186945 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.187095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.187251 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.187402 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.187564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.187722 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.187873 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.188022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.188197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.188494 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.188662 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.188906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.189074 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.189237 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.189439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.189608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.189894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.190060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.190211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:36:30.190478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.191047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.191632 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.192154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.192674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.193332 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.193886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.194436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.195037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.195579 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.195940 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.196386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.196793 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.197115 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.197498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.198058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.198545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.198873 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.199202 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.199529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.199855 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.200190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.200522 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.200876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.201319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.201647 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.201973 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.202299 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.202619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.202937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.203261 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.203600 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.203920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.204238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.204556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.204921 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.205238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.205572 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.206000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.206325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.207077 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.207077 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.207380 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.207797 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.207983 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.208309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.208809 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.209205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.209524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.210112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.210365 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.210633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.210881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.211131 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.211516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.211771 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.212106 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.212430 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.212789 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.213780 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.214122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.214546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.214876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.215167 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_db.sqlalchemy.engines [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.215371 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.215537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.215826 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.216149 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.216471 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.216893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.217151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.217471 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.217799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.218125 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.218451 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.218990 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.219269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.219613 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.220768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.220768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.220768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.221070 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.221266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.221621 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.221962 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.222344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.222598 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.222934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.223397 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.223747 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.223952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.224289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.224633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.225003 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.225324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.225666 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.226002 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.226329 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.226658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.227001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.227316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.227629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.227951 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.228267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.229196 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.229531 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.229854 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.230169 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.230486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.230803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.231136 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.231454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.231794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.232117 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.232433 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.232778 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.233100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.233455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.233772 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.234120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.234453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.234783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.235124 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.235444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.235780 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.236108 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.236437 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.236780 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.237113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.237442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.237769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.238095 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.238415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.238740 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.239065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.239475 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.239991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.240335 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.240665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.241023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.241349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.241690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.242017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.242343 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.242667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.243010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.243312 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.243657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.244001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.244417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.244808 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.245287 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.245637 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.245969 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.246301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.246686 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.247019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.247342 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.247671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.248263 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.248602 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.248985 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.250675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.250675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.250675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.250675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.250675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.251334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.251464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.251717 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.252079 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.252415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.253137 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.253674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.254183 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.255053 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.255510 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.256114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.256456 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.256817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.257155 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.257491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.257829 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.258148 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.258464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.258787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.259107 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.259424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.259807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.260335 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.260672 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.261038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.261362 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.261975 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.262342 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.262671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.263010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.263346 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.263678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.264000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.264337 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.264657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.265008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.265343 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.265667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.265985 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.266305 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.266630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.266954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.267271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.267597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.267915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.268257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.268576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.268999 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.269318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.269643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.269964 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.270281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.270598 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.270917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.271241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.271563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.271886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.272215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.272531 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.272940 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.273198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.273513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.273853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.274172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.274488 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.274823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.275145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.276010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.276334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.276658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.277300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.277632 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.278235 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.278583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.278919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.279280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.279633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.279952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.280269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.280589 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.280948 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.281274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.281596 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.281917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.282245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.282559 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.282883 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.283201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.283519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.283840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.284159 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.284519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.284891 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.285224 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.285553 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.285885 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.286209 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.286530 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.286854 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.287194 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.287522 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.287865 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.288192 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.288509 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.288980 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.289307 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.289636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.289968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.290293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.290631 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.291094 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.291906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.292697 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.292697 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.293014 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.293207 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.293529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.293884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.294235 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.294567 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.295009 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.295336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.295664 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.295987 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.296309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.296634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.297048 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.297386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.297710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.298049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.298369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.298706 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.299029 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.299362 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.299680 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.300009 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.300329 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.300659 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.301037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.301365 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.301699 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.302030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.302365 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.302690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.303025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.303358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.303693 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.304014 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.304359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.304681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.305034 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.305358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.305680 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.306000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.306318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.306709 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.307056 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.307368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.307707 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.308036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.308367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.308694 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.309045 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.309387 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.309710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.310057 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.310385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.310711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.311039 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.311367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.311704 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.312048 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.312385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.312723 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.313112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.313435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.313791 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.314128 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 10:36:30.314380 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 10:36:30.338404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_db.sqlalchemy.engines [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.386694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.context [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),879bb43f-01c6-4672-bf48-025868d9cf22(cell1) {{(pid=119120) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:36:30.391197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:36:30.392892 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:36:30.393746 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:36:30.395773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:36:30.406953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_db.sqlalchemy.engines [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.407819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_db.sqlalchemy.engines [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.511777 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.context [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),879bb43f-01c6-4672-bf48-025868d9cf22(cell1) {{(pid=119121) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 10:36:30.517001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:36:30.518630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:36:30.519445 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:36:30.521423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:36:30.532072 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_db.sqlalchemy.engines [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.533714 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_db.sqlalchemy.engines [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.679490 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_db.sqlalchemy.engines [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:30.815137 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_db.sqlalchemy.engines [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 10:36:31.004551 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: WARNING keystonemiddleware.auth_token [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:36:31.011756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: WARNING keystonemiddleware.auth_token [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:36:31.160419 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: WARNING keystonemiddleware.auth_token [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:36:31.167607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: WARNING keystonemiddleware.auth_token [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:36:31.386424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: WARNING keystonemiddleware.auth_token [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:36:31.392338 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: WARNING keystonemiddleware.auth_token [None req-225ec5c2-06bc-40d2-8c5c-aac452dcf5ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:36:31.398048 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a9914d89c0 pid: 119120 (default app) Jul 28 10:36:31.522146 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: WARNING keystonemiddleware.auth_token [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 10:36:31.527269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: WARNING keystonemiddleware.auth_token [None req-c87146f2-5530-4cb8-8c89-f1561401088a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 10:36:31.532622 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a9914d89c0 pid: 119121 (default app) Jul 28 10:37:04.153134 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-63ee3c2d-e533-48c1-bc57-2482b562e5b4 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Action: 'create', calling method: .version_select at 0x7fe47d680160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1685265580"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:05.540575 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-462508761", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "62d4883f-dea5-4f88-8684-dde642b6cfa0"}]}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:05.899838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-63ee3c2d-e533-48c1-bc57-2482b562e5b4 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.941365 Jul 28 10:37:05.900876 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Wed Jul 28 10:37:02 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2944 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 10:37:05.983684 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-94304350", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "325f419e-0afa-46c0-bdf9-fcbe0316bf42"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:05.995638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] validate_networks() for [('62d4883f-dea5-4f88-8684-dde642b6cfa0', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:37:06.106220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] validate_networks() for [('325f419e-0afa-46c0-bdf9-fcbe0316bf42', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:37:07.043015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:07.043500 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:07.043903 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:07.044311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:07.044952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:07.067634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:07.068529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:07.070052 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:07.070720 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:07.124526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:07.135498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for user 39dc329d6654473e869f8892dbb3e046 and project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:07.167866 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:37:07.172506 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:37:07.358688 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f25c4be8-08b0-4ed4-90d9-0d3e7f0ed052 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.970899 Jul 28 10:37:07.364881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:37:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 2979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:07.370485 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cc7a12de-b440-41ac-b1ca-d9b4af5a3e1b tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47d470af0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:07.513246 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cc7a12de-b440-41ac-b1ca-d9b4af5a3e1b tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9" status: 200 len: 346 microversion: 2.1 time: 0.146852 Jul 28 10:37:07.513938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:07 2021] GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9 => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:07.523542 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-672bbaf5-48b3-42f4-a8e6-adfd4dbebe57 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47d67f9d0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:07.678701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-672bbaf5-48b3-42f4-a8e6-adfd4dbebe57 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/8b81cd0d-2be6-4af5-9a16-1ee919c7ec8e" status: 200 len: 351 microversion: 2.1 time: 0.161955 Jul 28 10:37:07.681144 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:07 2021] GET /compute/v2.1/os-volumes/8b81cd0d-2be6-4af5-9a16-1ee919c7ec8e => generated 351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:07.686099 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-57cf7624-07a6-4f12-84ec-1316721dccb8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:07.687043 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-57cf7624-07a6-4f12-84ec-1316721dccb8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:07.856049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-57cf7624-07a6-4f12-84ec-1316721dccb8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:07.880483 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-57cf7624-07a6-4f12-84ec-1316721dccb8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1217 microversion: 2.1 time: 0.197870 Jul 28 10:37:07.883345 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 4/5] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:07 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:07.891027 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cd4b9031-8870-4176-a68b-07f003b98331 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Action: 'create', calling method: .version_select at 0x7fe47cc01160>, body: {"snapshot": {"volume_id": "6777302b-9db7-4a53-8700-eab4625815a9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2069333849"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:08.238173 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cd4b9031-8870-4176-a68b-07f003b98331 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.350668 Jul 28 10:37:08.246909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 5/6] 10.222.0.25 () {60 vars in 1162 bytes} [Wed Jul 28 10:37:07 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:08.262081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f4032699-410c-42ec-abe3-dea9920d2ca9 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cc01f70>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:08.330923 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f4032699-410c-42ec-abe3-dea9920d2ca9 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 287 microversion: 2.1 time: 0.073099 Jul 28 10:37:08.331745 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 6/7] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:08 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:08.359224 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-08ae5dbd-40ca-4db0-86bc-ea602264498a tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cbefee0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:08.390610 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:08.391187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:08.391589 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:08.392149 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:08.392568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:08.421978 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:08.422702 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:08.423666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:08.424255 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:08.449781 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-08ae5dbd-40ca-4db0-86bc-ea602264498a tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.110525 Jul 28 10:37:08.450551 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 7/8] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Jul 28 10:37:08 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:08.463605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-eb8ea63b-b570-4a81-aa01-ce360b8cf8dc tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb95dc0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:08.490896 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Getting quotas for project 8272e15ff3f54906846a9da0f16b95ca. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:08.502867 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Getting quotas for user c525549e4c5d41f49ce25b05c574c45e and project 8272e15ff3f54906846a9da0f16b95ca. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:08.518333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:37:08.521648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:37:08.547839 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-eb8ea63b-b570-4a81-aa01-ce360b8cf8dc tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 287 microversion: 2.1 time: 0.088159 Jul 28 10:37:08.548823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 8/9] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:08 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:08.699418 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c42fad92-de9f-4473-b15f-7e584f564d6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.796916 Jul 28 10:37:08.706571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 2/10] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:37:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 2805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:08.710880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b6ec8ed5-35f5-4388-9344-5a886928f85d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:08.713085 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b6ec8ed5-35f5-4388-9344-5a886928f85d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:08.807732 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b6ec8ed5-35f5-4388-9344-5a886928f85d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:08.822479 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b6ec8ed5-35f5-4388-9344-5a886928f85d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1213 microversion: 2.1 time: 0.115542 Jul 28 10:37:08.825249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 9/11] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:08 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:08.901878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-66fb9d6a-0af2-434f-9934-9996d6a9b4d9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:08.902519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-66fb9d6a-0af2-434f-9934-9996d6a9b4d9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:09.195079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-66fb9d6a-0af2-434f-9934-9996d6a9b4d9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:09.228572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-66fb9d6a-0af2-434f-9934-9996d6a9b4d9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1217 microversion: 2.1 time: 0.326190 Jul 28 10:37:09.241410 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 3/12] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:08 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:09.370560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ae8cf0bb-d1c6-4587-aae2-3ceeea8e819e tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cb95040>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:09.492652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ae8cf0bb-d1c6-4587-aae2-3ceeea8e819e tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/785f5aed-c441-409f-9223-a02dc5b4cfd2" status: 200 len: 350 microversion: 2.1 time: 0.126575 Jul 28 10:37:09.499319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 10/13] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:09 2021] GET /compute/v2.1/os-volumes/785f5aed-c441-409f-9223-a02dc5b4cfd2 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:09.561789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5bad8c2d-2b61-4211-a9c1-0faf9b7d6d35 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47d3f2d30>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:09.654443 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5bad8c2d-2b61-4211-a9c1-0faf9b7d6d35 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 287 microversion: 2.1 time: 0.097408 Jul 28 10:37:09.655333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 4/14] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:09 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:09.840215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e5a23d7d-628b-4d52-b8cd-e696bc030fb4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:09.841114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e5a23d7d-628b-4d52-b8cd-e696bc030fb4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:09.938974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e5a23d7d-628b-4d52-b8cd-e696bc030fb4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:09.945825 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e5a23d7d-628b-4d52-b8cd-e696bc030fb4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1213 microversion: 2.1 time: 0.110131 Jul 28 10:37:09.948910 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 11/15] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:09 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:10.248055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:10.248673 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:10.262459 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:10.263280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:10.266495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:10.267161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:10.529181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:10.543925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1e704355-9c42-4510-9242-dd9f9bfdfbd9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1221 microversion: 2.1 time: 0.300840 Jul 28 10:37:10.553284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 5/16] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:10 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1221 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:10.667880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0d9bddfd-5fc4-40f4-b83e-5275a8a00cbe tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb95ee0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:10.805211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0d9bddfd-5fc4-40f4-b83e-5275a8a00cbe tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 287 microversion: 2.1 time: 0.142779 Jul 28 10:37:10.807178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 12/17] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:10 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:10.967047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:10.968527 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:10.981627 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:10.982107 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:10.985006 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:10.986104 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:11.129503 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:11.142235 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e396aec7-aafd-4188-bfa7-2485f48179e4 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1217 microversion: 2.1 time: 0.177687 Jul 28 10:37:11.143219 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 6/18] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:10 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:11.575599 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:11.575599 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:11.590951 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:11.591507 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:11.593143 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:11.595667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:11.819917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-465e48dc-f882-4698-b404-142c8cb24b59 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb29670>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:11.885281 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-465e48dc-f882-4698-b404-142c8cb24b59 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 287 microversion: 2.1 time: 0.070710 Jul 28 10:37:11.886489 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 7/19] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:11 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:12.045783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:12.062358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d6055060-9510-4d5f-950a-82dc62df4bac tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1221 microversion: 2.1 time: 0.496622 Jul 28 10:37:12.068367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 13/20] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:11 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1221 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:12.160571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:12.161497 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:12.175771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:12.176259 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:12.177497 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:12.177602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:12.502250 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:12.511604 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b79e5427-3ca5-42a7-82cd-8ac8c74d2a3c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1209 microversion: 2.1 time: 0.356157 Jul 28 10:37:12.513145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 8/21] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:12 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1209 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:12.905524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cb09e864-a2c7-43d0-ada5-ba5168896ec5 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb10f70>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:12.978375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cb09e864-a2c7-43d0-ada5-ba5168896ec5 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 288 microversion: 2.1 time: 0.076838 Jul 28 10:37:12.978946 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 14/22] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:12 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:12.994499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-75b80b7a-9668-45e1-89d9-a121ac96fae7 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47d3faa60>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.085544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.086232 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:13.112639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:13.113137 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:13.113950 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:13.114389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:13.142243 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-75b80b7a-9668-45e1-89d9-a121ac96fae7 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 202 len: 0 microversion: 2.1 time: 0.156767 Jul 28 10:37:13.142824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 9/23] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Jul 28 10:37:12 2021] DELETE /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:37:13.152721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-57d54cd8-92a0-4d53-9005-0c115c362817 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb09e50>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.222202 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-57d54cd8-92a0-4d53-9005-0c115c362817 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 200 len: 287 microversion: 2.1 time: 0.073967 Jul 28 10:37:13.223737 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 10/24] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:13 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:13.478322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-119fa1b4-e91a-451a-ba10-c31ae13777fe tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cb15790>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.695530 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-119fa1b4-e91a-451a-ba10-c31ae13777fe tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/78790dcc-a626-416d-bff9-3bdfe2d2ada9" status: 200 len: 351 microversion: 2.1 time: 0.221848 Jul 28 10:37:13.702844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 11/25] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:13 2021] GET /compute/v2.1/os-volumes/78790dcc-a626-416d-bff9-3bdfe2d2ada9 => generated 351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:13.702844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:13.704513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:13.716776 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:13.722173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:13.723105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:13.728071 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:13.729447 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:13.749605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d5b9b95a-463c-4ab2-ac94-f61986bb5eb7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1277 microversion: 2.1 time: 0.668091 Jul 28 10:37:13.753386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 15/26] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:13 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1277 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:13.769736 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-67e9f240-5cff-4253-9cd0-29c6fc8a0e55 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cb43790>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.000854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:14.018957 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-35994f8e-b085-41e2-b4ca-aeee526215a3 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1273 microversion: 2.1 time: 0.317492 Jul 28 10:37:14.023061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 12/27] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:13 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:14.045741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-67e9f240-5cff-4253-9cd0-29c6fc8a0e55 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.290602 Jul 28 10:37:14.047250 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Jul 28 10:37:13 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:14.062135 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-30e6bdd6-6536-4762-8b0f-48e7c9b3fcc2 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cb15820>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.234653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6d159b0c-46a1-408d-abdf-80e38dcdaad7 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cadc160>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.291366 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-6d159b0c-46a1-408d-abdf-80e38dcdaad7 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] HTTP exception thrown: Snapshot 5f938e7c-a72f-4285-8fa2-c64ee15890b7 could not be found. Jul 28 10:37:14.292714 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6d159b0c-46a1-408d-abdf-80e38dcdaad7 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Returning 404 to user: Snapshot 5f938e7c-a72f-4285-8fa2-c64ee15890b7 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:37:14.294265 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6d159b0c-46a1-408d-abdf-80e38dcdaad7 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7" status: 404 len: 111 microversion: 2.1 time: 0.063434 Jul 28 10:37:14.294829 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 17/29] 10.222.0.25 () {58 vars in 1251 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/os-snapshots/5f938e7c-a72f-4285-8fa2-c64ee15890b7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:37:14.302887 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-eb73a3c5-d70e-44d8-bbff-6216c216e3c9 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cad2310>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.386950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-30e6bdd6-6536-4762-8b0f-48e7c9b3fcc2 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.330228 Jul 28 10:37:14.387789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 13/30] 10.222.0.25 () {58 vars in 1149 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:14.399775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f9d4d398-e707-422b-875f-9dc81354f8a9 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cae6a60>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.486457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-eb73a3c5-d70e-44d8-bbff-6216c216e3c9 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9" status: 202 len: 0 microversion: 2.1 time: 0.186944 Jul 28 10:37:14.490672 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 18/31] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Jul 28 10:37:14 2021] DELETE /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:37:14.495389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7a51fbfb-81dc-4210-8017-5f2fc133b01e tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb43af0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.643337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f9d4d398-e707-422b-875f-9dc81354f8a9 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.247168 Jul 28 10:37:14.644378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 14/32] 10.222.0.25 () {58 vars in 1134 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:14.654157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7a51fbfb-81dc-4210-8017-5f2fc133b01e tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9" status: 200 len: 345 microversion: 2.1 time: 0.162416 Jul 28 10:37:14.656468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b1aab270-32c9-46da-a774-dcb21076003d tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cae69d0>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.659326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 19/33] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:14.771691 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:14.774703 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:14.797245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:14.802998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:14.806653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:14.810343 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:14.911864 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b1aab270-32c9-46da-a774-dcb21076003d tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.259073 Jul 28 10:37:14.912954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 15/34] 10.222.0.25 () {58 vars in 1167 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:14.927051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-212705e7-daa2-44bd-b057-63788008b454 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cb09280>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:15.078776 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-212705e7-daa2-44bd-b057-63788008b454 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157325 Jul 28 10:37:15.079496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 16/35] 10.222.0.25 () {58 vars in 1170 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:15.087605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:15.088542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:15.108831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:15.110621 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:15.113021 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:15.121748 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:15.582826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:15.582826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-24b9658f-7723-4b53-855e-b0c2ec67cf1c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1271 microversion: 2.1 time: 0.471154 Jul 28 10:37:15.582826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 17/36] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:15 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1271 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:15.582826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-edc8c6d6-aaed-48d5-93a3-3d9cfcb591b3 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47deb3700>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.201637 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-edc8c6d6-aaed-48d5-93a3-3d9cfcb591b3 tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.632963 Jul 28 10:37:16.202978 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 18/37] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Jul 28 10:37:15 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:16.207095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4e33d85e-c9de-4407-9906-513e7d1ba719 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cafa8b0>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.288534 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-4e33d85e-c9de-4407-9906-513e7d1ba719 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] HTTP exception thrown: Volume 6777302b-9db7-4a53-8700-eab4625815a9 could not be found. Jul 28 10:37:16.289182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4e33d85e-c9de-4407-9906-513e7d1ba719 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Returning 404 to user: Volume 6777302b-9db7-4a53-8700-eab4625815a9 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:37:16.290954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4e33d85e-c9de-4407-9906-513e7d1ba719 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9" status: 404 len: 109 microversion: 2.1 time: 0.087356 Jul 28 10:37:16.291505 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 19/38] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:16 2021] GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:16.300366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3bf32833-6026-418c-9f9a-c5cbb8893c8d tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cae6af0>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.676085 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:16.684291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ee2fa43b-46e2-4d5e-99a2-f72f177ea40e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1275 microversion: 2.1 time: 1.918771 Jul 28 10:37:16.684894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 20/39] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:14 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1275 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:16.699871 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4d616952-ca44-43e5-ae01-e1352845b831 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cb2c280>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.734563 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3bf32833-6026-418c-9f9a-c5cbb8893c8d tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.437812 Jul 28 10:37:16.736511 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1188 bytes} [Wed Jul 28 10:37:16 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:16.743442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.744456 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:16.784221 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:16.792965 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-4d616952-ca44-43e5-ae01-e1352845b831 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] HTTP exception thrown: Volume 6777302b-9db7-4a53-8700-eab4625815a9 could not be found. Jul 28 10:37:16.793441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4d616952-ca44-43e5-ae01-e1352845b831 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Returning 404 to user: Volume 6777302b-9db7-4a53-8700-eab4625815a9 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:37:16.793992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:16.794280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4d616952-ca44-43e5-ae01-e1352845b831 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9" status: 404 len: 109 microversion: 2.1 time: 0.098095 Jul 28 10:37:16.794821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 21/41] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Jul 28 10:37:16 2021] DELETE /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:16.800457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fa201433-d3f3-43ca-a02d-7a9de868ed4e tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] Calling method '.version_select at 0x7fe47cadc790>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:16.810897 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:16.812523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:17.091548 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fa201433-d3f3-43ca-a02d-7a9de868ed4e tempest-VolumesTestJSON-1185929880 tempest-VolumesTestJSON-1185929880-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.295479 Jul 28 10:37:17.092114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1155 bytes} [Wed Jul 28 10:37:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:17.101114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-77fda2a0-11b5-4ae7-86b1-f98f5617af78 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Calling method '.version_select at 0x7fe47cadcf70>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:17.166401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:17.179854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cadb369d-35f3-4356-b51f-9beedc23e78d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1271 microversion: 2.1 time: 0.441732 Jul 28 10:37:17.193456 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:16 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1271 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:17.390466 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-77fda2a0-11b5-4ae7-86b1-f98f5617af78 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] HTTP exception thrown: Volume 6777302b-9db7-4a53-8700-eab4625815a9 could not be found. Jul 28 10:37:17.391674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-77fda2a0-11b5-4ae7-86b1-f98f5617af78 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] Returning 404 to user: Volume 6777302b-9db7-4a53-8700-eab4625815a9 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:37:17.394182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-77fda2a0-11b5-4ae7-86b1-f98f5617af78 tempest-VolumesSnapshotsTestJSON-604400133 tempest-VolumesSnapshotsTestJSON-604400133-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9" status: 404 len: 109 microversion: 2.1 time: 0.298470 Jul 28 10:37:17.395852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 23/44] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:17 2021] GET /compute/v2.1/os-volumes/6777302b-9db7-4a53-8700-eab4625815a9 => generated 109 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:17.702870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:17.706569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:17.718376 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:17.720120 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:17.722846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:17.728686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:18.441948 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c46a139d-6fa1-447c-a267-2478cfa2276b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'create', calling method: .version_select at 0x7fe47cb10820>, body: {"keypair": {"name": "tempest-keypair-1946550612"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:18.589066 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-c46a139d-6fa1-447c-a267-2478cfa2276b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:18.599376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-c46a139d-6fa1-447c-a267-2478cfa2276b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for user 9de460033b7846bfa2d49e86936e4b68 and project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:18.660351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:18.675257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-668f2473-70e1-4db5-9202-ec5ca0a57b96 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.976058 Jul 28 10:37:18.681037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 22/45] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:17 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:18.707689 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:18.713891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:18.756739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:18.762327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:18.765838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:18.774709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:19.148503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-c46a139d-6fa1-447c-a267-2478cfa2276b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:19.177818 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-c46a139d-6fa1-447c-a267-2478cfa2276b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for user 9de460033b7846bfa2d49e86936e4b68 and project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:19.214536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c46a139d-6fa1-447c-a267-2478cfa2276b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.351300 Jul 28 10:37:19.215604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 24/46] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Jul 28 10:37:17 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1353 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:37:19.699346 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:19.700061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:19.708667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:19.718947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:19.720824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:19.722371 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:19.762480 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:19.776094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a7225c68-fdf0-43e4-a3df-00d32113eb6f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 1.093496 Jul 28 10:37:19.779169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 23/47] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:18 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:20.797891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:20.799108 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:20.809946 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:20.810484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:20.811374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:20.811873 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:21.958141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:21.968194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9c6563eb-76f3-4347-b28c-8c154dfc0066 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 1.175177 Jul 28 10:37:21.977166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:20 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:22.232660 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:22.241157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-83384bec-2b0c-4211-a6c6-1bf12fef474d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 2.546513 Jul 28 10:37:22.251384 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 25/49] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:19 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:22.356300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-df3d8475-5635-4613-8107-230f0f54a609 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: .version_select at 0x7fe47cae61f0>, body: {"keypair": {"name": "tempest-keypair-1375017029"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:22.443029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-df3d8475-5635-4613-8107-230f0f54a609 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:22.462974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-df3d8475-5635-4613-8107-230f0f54a609 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for user 99b1261478f8499da914a9b8162a54e1 and project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:22.985080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:22.985713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:22.999081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:22.999438 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:23.000239 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:23.000686 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:23.344627 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-df3d8475-5635-4613-8107-230f0f54a609 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:23.369091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-df3d8475-5635-4613-8107-230f0f54a609 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for user 99b1261478f8499da914a9b8162a54e1 and project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:23.419264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-df3d8475-5635-4613-8107-230f0f54a609 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.374248 Jul 28 10:37:23.420269 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Jul 28 10:37:22 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:23.437413 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:23.439185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:23.460444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:23.472124 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:23.472995 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:23.499316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:23.935245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:23.969083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6418db5f-aa29-4313-9774-d8033d1db96d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.547256 Jul 28 10:37:23.971000 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 26/51] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:23 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:25.101254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5f039208-972f-44d5-87a2-dfc3494549f0 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Action: 'create', calling method: .version_select at 0x7fe47ca89940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2038636810", "metadata": {"Type": "work"}}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:25.262779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:25.279318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ca8a55b9-5b39-407e-aba7-dcedaae94902 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 2.297654 Jul 28 10:37:25.287450 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 26/52] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:22 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:25.294122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:25.316472 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:25.336984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:25.338084 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:25.339646 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:25.344057 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:26.235697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5f039208-972f-44d5-87a2-dfc3494549f0 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.264403 Jul 28 10:37:26.236411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 27/53] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Jul 28 10:37:23 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2266 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 10:37:26.249196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-70e0c804-cab7-40ef-b5c4-c0a9b4f81f4d tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Calling method '.version_select at 0x7fe47caaf430>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:26.451816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-70e0c804-cab7-40ef-b5c4-c0a9b4f81f4d tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631" status: 200 len: 353 microversion: 2.1 time: 0.207675 Jul 28 10:37:26.452842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 28/54] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:26 2021] GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:26.458616 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:26.459566 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:26.478164 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:26.479246 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:26.480387 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:26.481144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:27.079198 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:27.094784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9b735975-fae0-424f-ba6b-301b2a42360f tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.640568 Jul 28 10:37:27.095366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 29/55] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:26 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:27.416300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:27.438791 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5e0a9c4d-b227-408c-bd72-0e6d1eb00e64 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 2.148112 Jul 28 10:37:27.442020 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 27/56] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:25 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:27.467277 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9ca07f41-bd0c-4b6c-8662-d14eea0a3e68 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Calling method '.version_select at 0x7fe47cb150d0>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:27.622267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9ca07f41-bd0c-4b6c-8662-d14eea0a3e68 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631" status: 200 len: 354 microversion: 2.1 time: 0.158763 Jul 28 10:37:27.623750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 30/57] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:27 2021] GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631 => generated 354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:27.636438 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d2f1529a-2eab-4deb-85e1-8eaa4807cc75 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Calling method '.version_select at 0x7fe47cb95dc0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:27.794716 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d2f1529a-2eab-4deb-85e1-8eaa4807cc75 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631" status: 200 len: 354 microversion: 2.1 time: 0.163277 Jul 28 10:37:27.795301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 28/58] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:27 2021] GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:27.811856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cbd00d79-15fa-4fe8-bcab-d3952643c731 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Calling method '.version_select at 0x7fe47caaf3a0>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:27.923651 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cbd00d79-15fa-4fe8-bcab-d3952643c731 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631" status: 202 len: 0 microversion: 2.1 time: 0.115411 Jul 28 10:37:27.924708 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Jul 28 10:37:27 2021] DELETE /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:37:27.933894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-222aa9dd-3aaa-454e-a4bd-4af421278dbb tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Calling method '.version_select at 0x7fe47caa6a60>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:28.063932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-222aa9dd-3aaa-454e-a4bd-4af421278dbb tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631" status: 200 len: 353 microversion: 2.1 time: 0.135015 Jul 28 10:37:28.065227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 29/60] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:27 2021] GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:28.120266 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:28.123276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:28.133428 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.137679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.138879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.142918 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.558489 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:28.574148 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a63619a8-7f83-4d8a-9c5f-f78583d9d024 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.457467 Jul 28 10:37:28.584415 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 32/61] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:28 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:28.590646 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:28.592566 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:28.608997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.614359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.615383 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.615970 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.818503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-346412b2-c99a-47bd-83c4-4624520794c9 req-88fc5db1-00ed-4ddc-9525-e7aafed8d640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3db5de-a472-45e5-a610-d9bdd36b7bd3", "tag": "6f57a2ab-148f-4e21-aeaf-c45183c305ef"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:28.820972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:28.820972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:37:28.854280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-346412b2-c99a-47bd-83c4-4624520794c9 req-88fc5db1-00ed-4ddc-9525-e7aafed8d640 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.854959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-346412b2-c99a-47bd-83c4-4624520794c9 req-88fc5db1-00ed-4ddc-9525-e7aafed8d640 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.898018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-346412b2-c99a-47bd-83c4-4624520794c9 req-88fc5db1-00ed-4ddc-9525-e7aafed8d640 service nova] Creating event network-changed:6f57a2ab-148f-4e21-aeaf-c45183c305ef for instance 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 on hv-cinder-80043 Jul 28 10:37:28.900301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-346412b2-c99a-47bd-83c4-4624520794c9 req-88fc5db1-00ed-4ddc-9525-e7aafed8d640 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 28 10:37:28.901658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.902262 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.905637 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:28.906618 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:28.928958 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.compute.rpcapi [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 28 10:37:28.933806 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] Releasing lock "compute-rpcapi-router" {{(pid=119121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 28 10:37:28.959416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:28.973030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-28c19742-62d2-4da9-a5f0-1b523319314f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.385999 Jul 28 10:37:28.986069 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 33/62] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:28 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:28.995911 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5ebcf078-e37c-403a-94e6-6e3ebf4dd270 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.620582 Jul 28 10:37:28.999234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 30/63] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:29.077040 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b24c51ad-1b1c-4f9c-bffa-301496d5b541 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Calling method '.version_select at 0x7fe47ca99940>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:29.126394 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-b24c51ad-1b1c-4f9c-bffa-301496d5b541 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] HTTP exception thrown: Volume e7df5036-b492-46eb-9cb7-790cf5871631 could not be found. Jul 28 10:37:29.127015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b24c51ad-1b1c-4f9c-bffa-301496d5b541 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] Returning 404 to user: Volume e7df5036-b492-46eb-9cb7-790cf5871631 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:37:29.127865 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b24c51ad-1b1c-4f9c-bffa-301496d5b541 tempest-VolumesGetTestJSON-2123541771 tempest-VolumesGetTestJSON-2123541771-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631" status: 404 len: 109 microversion: 2.1 time: 0.055496 Jul 28 10:37:29.128888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 31/64] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:37:29 2021] GET /compute/v2.1/os-volumes/e7df5036-b492-46eb-9cb7-790cf5871631 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:37:29.291618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1757670565", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11ab1b17-9ef4-4433-b69d-ff3c73d89f04"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:29.408165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] validate_networks() for [('11ab1b17-9ef4-4433-b69d-ff3c73d89f04', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:37:29.597364 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:29.598111 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:29.607352 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:29.608185 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:29.611359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:29.612231 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:30.111933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:30.129875 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-527ff952-18f6-4579-a98b-50c92b0c865c tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.541531 Jul 28 10:37:30.134610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:29 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:30.142738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1523534967", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e98efdf-61ac-4cfd-96bc-8805f92caedb"}], "security_groups": [{"name": "tempest-securitygroup--2028582005"}], "key_name": "tempest-keypair-1946550612", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:30.153200 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:30.153662 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:30.154143 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:30.155113 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:30.155445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:30.166845 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:30.167481 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:30.168305 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:30.168771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:30.189233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Getting quotas for project 02bb4273bddb44d783e4291853ff94bc. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:30.194127 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Getting quotas for user ac6df9a764374ae093f4b8b9c5f9112c and project 02bb4273bddb44d783e4291853ff94bc. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:30.216773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:37:30.219113 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:37:30.350306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cf3ac1c0-083d-435a-b795-99f16b734348 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.370439 Jul 28 10:37:30.373002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:37:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:30.384712 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1893251637", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99b05afa-3957-4d6b-b545-1d387f52d9e8"}], "security_groups": [{"name": "tempest-securitygroup--1992757079"}], "key_name": "tempest-keypair-1375017029", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:30.410971 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] validate_networks() for [('2e98efdf-61ac-4cfd-96bc-8805f92caedb', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:37:30.642621 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] validate_networks() for [('99b05afa-3957-4d6b-b545-1d387f52d9e8', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:37:31.432817 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:31.434233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:31.434946 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:31.436081 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:31.437104 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:31.450683 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.451950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.453276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.454001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.482332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for project 64f97a7ceb6d4d14928726470b026565. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:31.491442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for user 99b1261478f8499da914a9b8162a54e1 and project 64f97a7ceb6d4d14928726470b026565. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:31.507018 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:37:31.510150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:37:31.573395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-03088050-c363-4ff7-9505-81a15f4c6809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.198837 Jul 28 10:37:31.574499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 35/67] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:37:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:31.580112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:31.580547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:31.588976 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.589432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.590232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.590846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.757384 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:31.757835 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:31.758275 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:31.758694 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:31.759111 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:31.775444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.776603 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.778986 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.779442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.823176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:31.830139 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for user 9de460033b7846bfa2d49e86936e4b68 and project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:31.857220 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:37:31.864084 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:37:31.924929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:31.935552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-670f8209-8528-4605-b55e-7cdb3cb1f54a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.359666 Jul 28 10:37:31.936163 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 36/68] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:31 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:31.954757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:31.955743 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:31.983851 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.984544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:31.985378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:31.985843 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:32.009043 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5af073d9-d608-4535-89a9-4add15c3e079 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.872717 Jul 28 10:37:32.012908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 33/69] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Jul 28 10:37:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:37:32.025956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:32.026939 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:32.042582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:32.043468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:32.048029 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:32.049085 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:32.214969 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:32.222516 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0bb39068-b889-4b5a-b338-072433c23bf2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1282 microversion: 2.1 time: 0.285099 Jul 28 10:37:32.231838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 37/70] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:31 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:32.257385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-7491787a-b6cb-4088-be47-a92320b920e6 req-a367dca3-d616-4c65-a258-b5b999ae0b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1", "tag": "122754f7-f4c7-428b-a951-12c2330d6835"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:32.267299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:32.267299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:32.287920 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-7491787a-b6cb-4088-be47-a92320b920e6 req-a367dca3-d616-4c65-a258-b5b999ae0b53 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:32.290307 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-7491787a-b6cb-4088-be47-a92320b920e6 req-a367dca3-d616-4c65-a258-b5b999ae0b53 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:32.344573 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-7491787a-b6cb-4088-be47-a92320b920e6 req-a367dca3-d616-4c65-a258-b5b999ae0b53 service nova] Creating event network-changed:122754f7-f4c7-428b-a951-12c2330d6835 for instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 on hv-cinder-80043 Jul 28 10:37:32.356809 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-7491787a-b6cb-4088-be47-a92320b920e6 req-a367dca3-d616-4c65-a258-b5b999ae0b53 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 28 10:37:32.363018 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:32.363471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:32.365869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:32.374624 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:32.385052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.compute.rpcapi [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 28 10:37:32.386552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] Releasing lock "compute-rpcapi-router" {{(pid=119120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 28 10:37:32.438885 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-78c5cecb-d888-4162-9df1-5def69aeefb5 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176001 Jul 28 10:37:32.444065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 38/71] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:32.463577 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3466c479-2c1d-42c1-8db1-307879ca9900 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:32.465855 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3466c479-2c1d-42c1-8db1-307879ca9900 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:32.677160 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3466c479-2c1d-42c1-8db1-307879ca9900 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:32.691788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3466c479-2c1d-42c1-8db1-307879ca9900 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1238 microversion: 2.1 time: 0.246114 Jul 28 10:37:32.698162 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 39/72] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:32 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1238 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:32.714001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bdd6b27d-a02c-4f13-98ae-a65ed7708e41 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:32.721144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bdd6b27d-a02c-4f13-98ae-a65ed7708e41 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:32.857602 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:32.871215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4beec2fc-60d0-4deb-b768-8a4e5f80abe6 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.856939 Jul 28 10:37:32.877291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 34/73] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:32 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:32.890608 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1173946817", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11ab1b17-9ef4-4433-b69d-ff3c73d89f04"}]}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:33.042744 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bdd6b27d-a02c-4f13-98ae-a65ed7708e41 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:33.044592 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] validate_networks() for [('11ab1b17-9ef4-4433-b69d-ff3c73d89f04', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:37:33.053663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bdd6b27d-a02c-4f13-98ae-a65ed7708e41 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:33.056628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bdd6b27d-a02c-4f13-98ae-a65ed7708e41 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:33.058123 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bdd6b27d-a02c-4f13-98ae-a65ed7708e41 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1282 microversion: 2.20 time: 0.358731 Jul 28 10:37:33.061031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 40/74] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:32 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1282 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:33.069378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:33.070773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:33.085070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:33.085998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:33.087854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:33.089330 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:33.312658 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:33.328341 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-49d54663-eb2f-4575-a513-209cbad48abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.261144 Jul 28 10:37:33.331313 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 41/75] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:33 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:33.715915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:33.716533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:33.722282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:33.722919 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:33.723858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:33.724430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:33.861708 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:33.871082 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6f4c399f-71f7-4dae-bf49-8f8b8b19cbc1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1296 microversion: 2.1 time: 0.161388 Jul 28 10:37:33.871666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 42/76] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:33 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:33.893644 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:33.895903 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:33.922181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:33.923748 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:33.926636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:33.928512 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:34.628013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:37:34.631810 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:37:34.633193 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:37:34.634374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:37:34.635881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:37:34.684697 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:34.687741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:34.693299 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:34.696883 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:34.766968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Getting quotas for project 02bb4273bddb44d783e4291853ff94bc. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:37:34.794014 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Getting quotas for user ac6df9a764374ae093f4b8b9c5f9112c and project 02bb4273bddb44d783e4291853ff94bc. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:37:34.817736 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:37:34.819949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:37:34.927988 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-77c21839-2565-4e2c-bb53-92814fd8abf1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.049399 Jul 28 10:37:34.934956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:34.937088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 35/77] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:37:32 2021] POST /compute/v2.1/servers => generated 383 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:37:34.942869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-311ca247-9563-4652-bd61-9e8f85b6fcfa tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 1.053737 Jul 28 10:37:34.943871 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:34.945896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:34.954351 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:34.954823 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 43/78] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:33 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:34.955473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:34.956689 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:34.958113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:34.965074 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:34.969333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:34.981133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:34.981589 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:34.982757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:34.983337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:35.059265 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:35.068376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:35.070878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:35.072144 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3d4a4caf-2afc-45ee-8331-d7622d960124 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1340 microversion: 2.20 time: 0.133806 Jul 28 10:37:35.083290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 36/79] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:34 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1340 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:35.088499 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:35.090088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:35.096900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:35.097592 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:35.098957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:35.099726 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:35.536798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:35.548417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7416c94c-948c-432b-8a27-5dc927d7f062 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.463785 Jul 28 10:37:35.549222 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:35 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:35.562236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-76511184-45bf-49c9-abbc-a6677c824830 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:35.563341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-76511184-45bf-49c9-abbc-a6677c824830 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:35.715771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:35.725823 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d2edd0e5-67f8-41d5-b8fd-9e1ff623f677 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.768374 Jul 28 10:37:35.735290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 44/81] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:34 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:35.963808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:35.964484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:35.973741 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:35.974838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:35.975967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:35.977312 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:35.991442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-76511184-45bf-49c9-abbc-a6677c824830 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:35.999303 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-76511184-45bf-49c9-abbc-a6677c824830 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1222 microversion: 2.1 time: 0.448819 Jul 28 10:37:36.001060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 38/82] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:35 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1222 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:36.093486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:36.094559 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:36.106386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:36.110188 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:36.112347 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:36.114598 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:36.297667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:36.324033 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:36.325588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:36.334324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0ec71b02-f22f-4ca3-952b-4844b6529234 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1340 microversion: 2.20 time: 0.244347 Jul 28 10:37:36.334909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 39/83] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:36 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1340 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:37:36.355808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:36.365273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c411fc1c-eb11-48a0-bf42-f5974aacbbd2 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.408051 Jul 28 10:37:36.367492 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 45/84] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:35 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:36.575715 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:36.577356 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:36.593089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:36.594924 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:36.596604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:36.602278 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:36.745889 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:36.746445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:36.760816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:36.761265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:36.762039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:36.773618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.221632 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:37.239552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4708297d-538b-419f-b723-c6400d75c6bc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.500428 Jul 28 10:37:37.240965 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 46/85] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:36 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:37.247509 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:37.248737 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:37.258748 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.259562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.262294 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.263032 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.411493 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:37.425156 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-804069b0-a81c-43db-9dc1-6b57bfdba35e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1280 microversion: 2.1 time: 0.182184 Jul 28 10:37:37.426344 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 47/86] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:37 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:37.485779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:37.495829 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3b5152eb-2108-428f-9103-c941f4b2e293 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.932353 Jul 28 10:37:37.496927 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 40/87] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:36 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:37.504172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:37.505784 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:37.516192 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.523086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.524289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.525119 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.534187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-53811540-1cd9-434c-90ac-42f0eecc256c req-1deac497-dbbe-4562-9930-5a33ec3b37b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1075c593-6301-4ed9-b795-78c416194982", "tag": "b2d77924-3a3e-4775-b174-f86027863c1c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:37.535934 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:37.535934 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:37.555514 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-53811540-1cd9-434c-90ac-42f0eecc256c req-1deac497-dbbe-4562-9930-5a33ec3b37b1 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.555968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-53811540-1cd9-434c-90ac-42f0eecc256c req-1deac497-dbbe-4562-9930-5a33ec3b37b1 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.581794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-53811540-1cd9-434c-90ac-42f0eecc256c req-1deac497-dbbe-4562-9930-5a33ec3b37b1 service nova] Creating event network-changed:b2d77924-3a3e-4775-b174-f86027863c1c for instance 1075c593-6301-4ed9-b795-78c416194982 on hv-cinder-80043 Jul 28 10:37:37.587731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-53811540-1cd9-434c-90ac-42f0eecc256c req-1deac497-dbbe-4562-9930-5a33ec3b37b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160055 Jul 28 10:37:37.589158 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 48/88] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:37.595183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:37.595721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:37.602543 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.603000 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.603788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:37.604824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:37.989646 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.001661 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-37935964-b15d-4c78-bca2-04b328e35c52 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.410550 Jul 28 10:37:38.002847 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 49/89] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:37 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:38.019907 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-0eaca153-9fdc-4c4a-95a6-0982676c4339 req-47baac2d-179e-4cdf-9218-352154d7d278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3", "tag": "82804a28-d133-4800-8d06-025b1596883a"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:38.026041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:38.026041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:38.050126 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0eaca153-9fdc-4c4a-95a6-0982676c4339 req-47baac2d-179e-4cdf-9218-352154d7d278 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.053082 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0eaca153-9fdc-4c4a-95a6-0982676c4339 req-47baac2d-179e-4cdf-9218-352154d7d278 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.082495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-0eaca153-9fdc-4c4a-95a6-0982676c4339 req-47baac2d-179e-4cdf-9218-352154d7d278 service nova] Creating event network-changed:82804a28-d133-4800-8d06-025b1596883a for instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 on hv-cinder-80043 Jul 28 10:37:38.093727 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-0eaca153-9fdc-4c4a-95a6-0982676c4339 req-47baac2d-179e-4cdf-9218-352154d7d278 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089479 Jul 28 10:37:38.095256 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 50/90] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:38.265148 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:38.266405 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:38.281802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.294405 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.295382 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.299398 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.301432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.307228 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.309208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.310575 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4fa49de2-4ece-4761-bc23-17ec3bc3a52f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.812259 Jul 28 10:37:38.311385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 41/91] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:37 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:38.444036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:38.445655 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:38.463461 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.465441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.474236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.475196 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.689513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.700515 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-279e34e3-185a-43f6-99ed-de0a0d74c4d0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1280 microversion: 2.1 time: 0.258771 Jul 28 10:37:38.713187 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 42/92] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:38 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1280 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:38.722583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:38.724109 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:38.740529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.741030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.742609 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:38.743667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:38.821390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:38.834208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f7c55dfc-879a-4943-a762-1cd0f5fe1d7a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.580599 Jul 28 10:37:38.839868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 51/93] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:38 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:39.196554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-6d64adf5-16c1-466c-b047-f0e88f8c8c30 req-c41eae39-d8fa-432d-a358-5d27a3e522bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3db5de-a472-45e5-a610-d9bdd36b7bd3", "name": "network-vif-plugged", "status": "completed", "tag": "6f57a2ab-148f-4e21-aeaf-c45183c305ef"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:39.200399 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:39.200399 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:39.213131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-6d64adf5-16c1-466c-b047-f0e88f8c8c30 req-c41eae39-d8fa-432d-a358-5d27a3e522bb service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.216979 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-6d64adf5-16c1-466c-b047-f0e88f8c8c30 req-c41eae39-d8fa-432d-a358-5d27a3e522bb service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.247385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-6d64adf5-16c1-466c-b047-f0e88f8c8c30 req-c41eae39-d8fa-432d-a358-5d27a3e522bb service nova] Creating event network-vif-plugged:6f57a2ab-148f-4e21-aeaf-c45183c305ef for instance 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 on hv-cinder-80043 Jul 28 10:37:39.255040 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-6d64adf5-16c1-466c-b047-f0e88f8c8c30 req-c41eae39-d8fa-432d-a358-5d27a3e522bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413322 Jul 28 10:37:39.255950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 52/94] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:39.264262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:39.265569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:39.274869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.275645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.276905 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.277625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.364072 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:39.372361 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9025aa07-884a-471d-a69e-855e9f5dfdf7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.657757 Jul 28 10:37:39.376532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 43/95] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:38 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:39.389191 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:39.390509 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:39.405764 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.407589 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.409774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.410298 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.747858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:39.762535 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-466a248c-4772-40b3-8a3f-f88019d8bebf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.504325 Jul 28 10:37:39.763222 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 53/96] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:39 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:39.778390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:39.779653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:39.793514 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.795952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.798069 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.798705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.892621 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:39.902837 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:39.904886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:39.906197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-313009b1-ba07-494c-b4e5-bedc88d8050a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.528505 Jul 28 10:37:39.907732 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 44/97] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:39 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:39.915712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:39.917761 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:39.927374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.928349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:39.929927 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:39.930611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.083144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:40.091723 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2efcb73e-256b-41dc-9ed8-dd5e51efd27a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.326992 Jul 28 10:37:40.092651 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 54/98] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:39 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:40.309657 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-c487ac55-8d4f-4a81-82c1-3a8200029f21 req-f863b1e0-82da-40f3-ba08-9098ed9f50f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:40.311483 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:40.311483 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:40.325626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c487ac55-8d4f-4a81-82c1-3a8200029f21 req-f863b1e0-82da-40f3-ba08-9098ed9f50f8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.326572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c487ac55-8d4f-4a81-82c1-3a8200029f21 req-f863b1e0-82da-40f3-ba08-9098ed9f50f8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.364063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-c487ac55-8d4f-4a81-82c1-3a8200029f21 req-f863b1e0-82da-40f3-ba08-9098ed9f50f8 service nova] Creating event network-changed:602fc625-de40-4d7c-8ac1-0c239e6258a7 for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b on hv-cinder-80043 Jul 28 10:37:40.372232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-c487ac55-8d4f-4a81-82c1-3a8200029f21 req-f863b1e0-82da-40f3-ba08-9098ed9f50f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066247 Jul 28 10:37:40.373161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 55/99] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:40.392286 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:40.393053 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:40.400875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.401513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.402671 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.403331 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.531169 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:40.538659 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9c6364cf-b22f-4130-97b5-48a25386681d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.629179 Jul 28 10:37:40.539354 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 45/100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:39 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:40.652448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:40.666041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-71488161-94ec-4006-8163-0ff081b78f82 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.277565 Jul 28 10:37:40.673494 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 56/101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:40 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:40.780146 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:40.780731 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:40.786915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.787368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.788140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.788577 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.925983 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:40.926940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:40.935020 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.935547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:40.936442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:40.937003 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.089504 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:41.100290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:41.102465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:41.103810 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f706c6b1-3f24-474a-bdbd-a2ce0cb8652b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.181955 Jul 28 10:37:41.104844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 57/102] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:40 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:37:41.110205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:41.111034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:41.117381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.118150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.119071 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.119671 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.140582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:41.150947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cdf420f0-bb72-4467-a54e-a72e7bdbcea7 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.373913 Jul 28 10:37:41.151847 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 46/103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:40 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:41.324647 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-f16e1196-a68f-4205-9c35-13624de2f95f req-321d0375-5b7f-4a60-be85-f59581c9b078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1", "name": "network-vif-plugged", "status": "completed", "tag": "122754f7-f4c7-428b-a951-12c2330d6835"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:41.326403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:41.326403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:37:41.336997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:41.339971 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-f16e1196-a68f-4205-9c35-13624de2f95f req-321d0375-5b7f-4a60-be85-f59581c9b078 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.340424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-f16e1196-a68f-4205-9c35-13624de2f95f req-321d0375-5b7f-4a60-be85-f59581c9b078 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.346900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f69174ce-3819-4b52-906b-f7fc1606dd56 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.240709 Jul 28 10:37:41.348610 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 58/104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:41 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:41.361244 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-f16e1196-a68f-4205-9c35-13624de2f95f req-321d0375-5b7f-4a60-be85-f59581c9b078 service nova] Creating event network-vif-plugged:122754f7-f4c7-428b-a951-12c2330d6835 for instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 on hv-cinder-80043 Jul 28 10:37:41.366758 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-f16e1196-a68f-4205-9c35-13624de2f95f req-321d0375-5b7f-4a60-be85-f59581c9b078 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046659 Jul 28 10:37:41.367571 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 47/105] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:41.555724 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:41.556640 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:41.564119 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.564917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.565993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.566423 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.709840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:41.711134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:41.716219 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:41.725006 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.725594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:41.725998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-64f08eed-a5b9-43a7-a691-fa20fc9758c6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.174631 Jul 28 10:37:41.726645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 59/106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:41 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:41.727247 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:41.727917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.114166 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.124518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:42.125389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:42.125854 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-87d2f4e2-4b01-41d7-9f19-1998072df738 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.441701 Jul 28 10:37:42.126425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 48/107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:41 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:42.140424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.141165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.142284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.142940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.172917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:42.174361 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:42.181104 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.181525 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.182308 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.182756 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.299663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.308717 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.310709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.312071 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a40b8f7b-1eb8-43ec-96ca-246a4fddd679 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.191627 Jul 28 10:37:42.312719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 60/108] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:42 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:42.368352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:42.369686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:42.381013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.382167 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.383800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.384739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.413460 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.416624 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d6a61378-9f7d-4144-81cf-13433679bbbd tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.250279 Jul 28 10:37:42.419713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 49/109] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:42 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:42.456669 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-bfb9a8ca-10e0-4148-89cf-5d873bb215fb req-e504e452-aa4a-4a40-b798-a0fa233f83e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd28e13-6930-4641-9020-5257ca4327af", "tag": "34faabe4-239a-4508-b886-66e6cb2243a3"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:42.459015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:42.459015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:37:42.466631 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-bfb9a8ca-10e0-4148-89cf-5d873bb215fb req-e504e452-aa4a-4a40-b798-a0fa233f83e5 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.467263 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-bfb9a8ca-10e0-4148-89cf-5d873bb215fb req-e504e452-aa4a-4a40-b798-a0fa233f83e5 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.481081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-bfb9a8ca-10e0-4148-89cf-5d873bb215fb req-e504e452-aa4a-4a40-b798-a0fa233f83e5 service nova] Creating event network-changed:34faabe4-239a-4508-b886-66e6cb2243a3 for instance 6cd28e13-6930-4641-9020-5257ca4327af on hv-cinder-80043 Jul 28 10:37:42.486657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-bfb9a8ca-10e0-4148-89cf-5d873bb215fb req-e504e452-aa4a-4a40-b798-a0fa233f83e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Jul 28 10:37:42.487480 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 50/110] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:42.563254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.571657 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b804412d-8875-4f83-8e07-25f61972f47c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.209051 Jul 28 10:37:42.572230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 61/111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:42 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:42.743574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:42.744270 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:42.751690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.752466 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.753696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:42.754252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:42.912274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:42.923490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-529b3952-a1dd-4831-aafe-ee2e77c29bde tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.184457 Jul 28 10:37:42.934452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 51/112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:42 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:43.142923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:43.144095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:43.162084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.163019 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.164713 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.165447 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.330846 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:43.331454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:43.341043 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.344592 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.345607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.347103 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.381050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:43.426087 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ad5e6a88-bcdc-495b-a915-8f6d47d79809 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.286004 Jul 28 10:37:43.428076 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 62/113] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:43 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:43.445332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:43.446792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:43.459918 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.460792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.462388 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.463080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.939409 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:43.948343 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3690bc90-857d-4cc6-b5eb-21a54eb1ba2d tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.516166 Jul 28 10:37:43.951177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 63/114] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:43 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:43.965838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:43.966460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:43.973150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.973919 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:43.975184 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:43.976087 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:44.116346 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.125161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-50f3b382-c615-4309-8e68-1ac9aad5df83 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.163270 Jul 28 10:37:44.125731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 64/115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:43 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:44.130181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:44.130987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:44.136864 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:44.137573 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:44.138347 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:44.138778 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:44.178497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.191457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.194070 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.196292 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-97dfcd64-83ef-4f26-ac6e-24245c415545 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.869152 Jul 28 10:37:44.197648 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 52/116] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:43 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:44.303960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.318178 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ec77e997-0578-48e4-862e-7a85290d25a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1317 microversion: 2.1 time: 0.190228 Jul 28 10:37:44.320084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 65/117] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:44 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:44.445075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:44.445691 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:44.451673 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:44.452119 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:44.454504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:44.455157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:44.926341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:44.935499 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7593d9ac-a592-4e53-892c-c411e77852be tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.493964 Jul 28 10:37:44.949839 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 53/118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:44 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:44.968821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:44.969963 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:44.977977 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:44.982498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:44.983577 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:44.984187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.143215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:45.143934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:45.159856 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.160325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.161153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.161602 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.309754 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:45.319405 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e7cf0c60-c1fb-425c-9737-610b2caa3205 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1313 microversion: 2.1 time: 0.355160 Jul 28 10:37:45.321833 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 66/119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:44 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:45.338822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-0337ad4b-5c2e-4000-a80f-a5927257edac req-dfe857ff-a345-4a5c-b651-4dcc605f1690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1075c593-6301-4ed9-b795-78c416194982", "name": "network-vif-plugged", "status": "completed", "tag": "b2d77924-3a3e-4775-b174-f86027863c1c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:45.341990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:45.341990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:45.360348 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0337ad4b-5c2e-4000-a80f-a5927257edac req-dfe857ff-a345-4a5c-b651-4dcc605f1690 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.361527 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0337ad4b-5c2e-4000-a80f-a5927257edac req-dfe857ff-a345-4a5c-b651-4dcc605f1690 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.392587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-0337ad4b-5c2e-4000-a80f-a5927257edac req-dfe857ff-a345-4a5c-b651-4dcc605f1690 service nova] Creating event network-vif-plugged:b2d77924-3a3e-4775-b174-f86027863c1c for instance 1075c593-6301-4ed9-b795-78c416194982 on hv-cinder-80043 Jul 28 10:37:45.408319 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-0337ad4b-5c2e-4000-a80f-a5927257edac req-dfe857ff-a345-4a5c-b651-4dcc605f1690 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085050 Jul 28 10:37:45.411131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 67/120] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:45.418365 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:45.419363 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:45.426676 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.427923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.428953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.430391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.646208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:45.657995 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7e934a2a-ae4e-4b55-8fc2-72519328f932 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.519250 Jul 28 10:37:45.659608 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 54/121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:45 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:45.665676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:45.666432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:45.674229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.675110 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.676038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.676604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.713242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:45.723467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:45.725075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:45.726755 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-eae06856-ada0-43bf-a0d3-ee0767b30b3b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.313617 Jul 28 10:37:45.727331 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 68/122] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:45 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:45.958351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:45.960881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:45.978043 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.979766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:45.982066 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:45.983751 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:46.140230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:46.155540 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-396d0a39-6799-4e51-8e56-460bbca0956f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.201800 Jul 28 10:37:46.160785 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 69/123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:45 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:46.290426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:46.298000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8a46576e-120a-44f0-ae16-410785e480de tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1506 microversion: 2.1 time: 0.637026 Jul 28 10:37:46.309696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 55/124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:45 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1506 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:46.338630 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:46.339990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:46.347747 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:46.348360 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:46.349460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:46.350168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:46.488780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:46.498467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9e6b15d4-627c-460c-8c02-95785591cedf tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1500 microversion: 2.1 time: 0.165263 Jul 28 10:37:46.499145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 70/125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:46 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:46.676950 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:46.677574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:46.684910 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:46.685590 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:46.686545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:46.687128 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:46.745717 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:46.746429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:46.752697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:46.753427 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:46.754423 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:46.755192 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:47.026045 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.034859 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b04e7b26-eadf-4347-818d-bd35eba60b3f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.361833 Jul 28 10:37:47.036249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 56/126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:46 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:47.073835 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.094320 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.095806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.096941 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-89e17411-adfd-4af0-a3aa-47e00308c178 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.355792 Jul 28 10:37:47.101746 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 71/127] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:46 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:47.175043 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:47.182425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:47.191213 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:47.192109 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:47.193982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:47.194608 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:47.386888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:47.395148 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-09032ae8-8b0a-4715-8785-800eb42c9bd7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1364 microversion: 2.1 time: 0.225079 Jul 28 10:37:47.395943 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 57/128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:47 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:47.761131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c921b937-6d5b-41af-b555-31025931f072"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:47.762520 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:47.770308 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:47.771262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:47.772521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:47.773846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:48.046035 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1b7a9f2-1b54-4e69-97ee-59fd87532d31"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:48.047862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:48.055762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:48.056238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:48.057151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:48.057597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.723124 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f1978204-7202-4416-9853-e5aca589f8c5 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.965492 Jul 28 10:37:50.723960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 72/129] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:37:47 2021] POST /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3/os-volume_attachments => generated 194 bytes in 2968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:50.741480 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:50.743088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:50.753454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:50.754854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.756443 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:50.757309 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.763246 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f668c488-0af7-45af-9c4c-53b67d6dd898 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "POST /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.721315 Jul 28 10:37:50.765605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 58/130] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:37:48 2021] POST /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1/os-volume_attachments => generated 194 bytes in 2725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:50.774752 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:50.775530 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:50.794378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:50.800122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.801349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:50.801998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.943589 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:50.954053 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d10c2903-fa36-4b19-a30b-8371e09bc092 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.228759 Jul 28 10:37:50.955435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 73/131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:50 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:50.962735 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:50.963918 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:50.971697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:50.972144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.972951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:50.973374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:50.986611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:50.998311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.000015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.001182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2d85bff2-a968-44ec-a086-f9abbdf17857 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.234427 Jul 28 10:37:51.001733 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 59/132] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:50 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:51.118567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:51.129905 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c0528f82-2cc8-4117-be3b-ffb3b2ba4c66 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1551 microversion: 2.1 time: 0.172075 Jul 28 10:37:51.130615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 74/133] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:50 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:51.147721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:51.149348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:51.156109 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:51.156798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:51.157902 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:51.158532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:51.267924 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ca7ed132-ba3c-4a03-837d-548fdad7482b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123157 Jul 28 10:37:51.268783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 60/134] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Jul 28 10:37:51 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:51.979236 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:51.980700 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:51.987988 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:51.988631 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:51.989616 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:51.990233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:52.021125 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:52.022353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:52.032694 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:52.033429 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:52.034454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:52.035215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:52.179732 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:52.190532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:52.192510 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:52.194186 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8f47713a-3a24-4a30-9bd6-7cca85c37ba2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.178368 Jul 28 10:37:52.194869 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 61/135] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:52 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:37:52.285842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:52.293952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-701da6b9-a87c-4e2c-8b37-8d809e057395 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.319137 Jul 28 10:37:52.294834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 75/136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:51 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:52.765640 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:52.766649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:52.768966 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-47a9006e-063c-47b7-a2fd-936bd035ab94 req-25312d31-2067-48d1-90e2-4497a76c8274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1075c593-6301-4ed9-b795-78c416194982", "tag": "b2d77924-3a3e-4775-b174-f86027863c1c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:52.770547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:52.770547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:52.774230 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:52.774807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:52.775712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:52.776107 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:52.788598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-47a9006e-063c-47b7-a2fd-936bd035ab94 req-25312d31-2067-48d1-90e2-4497a76c8274 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:52.789245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-47a9006e-063c-47b7-a2fd-936bd035ab94 req-25312d31-2067-48d1-90e2-4497a76c8274 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:52.800378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-47a9006e-063c-47b7-a2fd-936bd035ab94 req-25312d31-2067-48d1-90e2-4497a76c8274 service nova] Creating event network-changed:b2d77924-3a3e-4775-b174-f86027863c1c for instance 1075c593-6301-4ed9-b795-78c416194982 on hv-cinder-80043 Jul 28 10:37:52.807626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-47a9006e-063c-47b7-a2fd-936bd035ab94 req-25312d31-2067-48d1-90e2-4497a76c8274 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042327 Jul 28 10:37:52.808378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 76/137] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:37:53.213771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.214586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:53.221507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:53.221884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:53.222661 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:53.223092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:53.348909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:53.357759 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:53.359392 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:53.360550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-52880510-a9ed-4301-ba42-521bd5d485c0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.151843 Jul 28 10:37:53.361209 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 77/138] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:53 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:37:53.365592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:53.366472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:53.375030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:53.375585 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:53.376412 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:53.376865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:53.507135 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:53.515741 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6187e8e4-ed38-49ac-926b-b408fbfd64c9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.153298 Jul 28 10:37:53.517306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 78/139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:53 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:54.379079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:54.379706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:54.386658 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:54.387101 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:54.387857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:54.388299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:54.509351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:54.517095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:54.518592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:54.519665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d8620e6f-5159-4edd-973f-e3c03d9951e5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.144273 Jul 28 10:37:54.520235 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 79/140] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:54 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:37:54.532457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:54.533084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:54.538935 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:54.539378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:54.540139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:54.540574 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:54.658522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:54.666253 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f125aadd-4020-4c32-9848-7f3dc7bd6876 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.137145 Jul 28 10:37:54.666819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 80/141] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:54 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:55.080985 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-afee9ccf-f7ac-46d4-aff3-508ae8673a26 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 2.318731 Jul 28 10:37:55.082744 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 62/142] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:37:52 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:55.174768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-fc88578b-db0d-47cb-9d95-2f04f87efbad req-77601f90-83ea-498c-8ae3-da8d88dd9744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3", "name": "network-vif-plugged", "status": "completed", "tag": "82804a28-d133-4800-8d06-025b1596883a"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:55.176508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:55.176508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:37:55.199099 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-fc88578b-db0d-47cb-9d95-2f04f87efbad req-77601f90-83ea-498c-8ae3-da8d88dd9744 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:55.199590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-fc88578b-db0d-47cb-9d95-2f04f87efbad req-77601f90-83ea-498c-8ae3-da8d88dd9744 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:55.211792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-fc88578b-db0d-47cb-9d95-2f04f87efbad req-77601f90-83ea-498c-8ae3-da8d88dd9744 service nova] Creating event network-vif-plugged:82804a28-d133-4800-8d06-025b1596883a for instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 on hv-cinder-80043 Jul 28 10:37:55.218395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-fc88578b-db0d-47cb-9d95-2f04f87efbad req-77601f90-83ea-498c-8ae3-da8d88dd9744 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054802 Jul 28 10:37:55.219472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 81/143] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:55.541363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:55.542233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:55.549875 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:55.550564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:55.551953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:55.551953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:55.691871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:55.692507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:55.700930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:55.700930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:55.700930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:55.700930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:55.750932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:55.758994 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:55.760494 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:55.761594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-20afafc7-2983-40b4-80bf-391ce4319fb0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.225676 Jul 28 10:37:55.762146 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 63/144] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:55 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:55.842633 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:55.850465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2290c260-dad5-4272-99c0-b2ca2ecb187e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.170109 Jul 28 10:37:55.851958 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 82/145] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:55 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:56.092882 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:56.093825 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:56.100717 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:56.102773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:56.103566 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:56.104005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:56.230114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-97fde96b-3309-4c48-a9bf-9079d9481ce1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 0.140869 Jul 28 10:37:56.230745 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 64/146] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:37:56 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:56.779716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:56.781047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:56.786893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:56.787412 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:56.788917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:56.789686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:56.869433 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:56.872804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:56.885931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:56.886391 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:56.887173 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:56.887612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:56.920827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:56.929861 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:56.931625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:56.932831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5a81ce4e-78c8-4bb8-b8e8-0cefa87b5e5a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.156903 Jul 28 10:37:56.933506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 83/147] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:56 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:37:57.063215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:57.072984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dcbf6f4a-8b60-4e8f-a6e1-68cdf50f2115 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.208021 Jul 28 10:37:57.078682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 65/148] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:56 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:57.242466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:57.243682 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:57.254308 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:57.258163 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:57.259432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:57.261558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:57.359368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-15878d53-3a2c-4a87-b2de-984e0c338500 req-0c90cfe6-9d21-49a1-a83f-4bf9c49a52e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "name": "network-vif-plugged", "status": "completed", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:57.360900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:57.360900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:37:57.369060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-15878d53-3a2c-4a87-b2de-984e0c338500 req-0c90cfe6-9d21-49a1-a83f-4bf9c49a52e1 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:57.369731 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-15878d53-3a2c-4a87-b2de-984e0c338500 req-0c90cfe6-9d21-49a1-a83f-4bf9c49a52e1 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:57.383133 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-15878d53-3a2c-4a87-b2de-984e0c338500 req-0c90cfe6-9d21-49a1-a83f-4bf9c49a52e1 service nova] Creating event network-vif-plugged:602fc625-de40-4d7c-8ac1-0c239e6258a7 for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b on hv-cinder-80043 Jul 28 10:37:57.389529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-15878d53-3a2c-4a87-b2de-984e0c338500 req-0c90cfe6-9d21-49a1-a83f-4bf9c49a52e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033542 Jul 28 10:37:57.390652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 66/149] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:57.463826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-77a4b547-0311-4f72-b9cb-b89cdf495960 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 0.225945 Jul 28 10:37:57.464856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 84/150] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:37:57 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:57.953724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:57.954793 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:57.963369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:57.963819 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:57.964594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:57.965054 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:58.090871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:58.091462 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:58.091937 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:58.098560 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:58.099262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:58.099881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:58.100181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:58.100716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:58.101480 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:58.102715 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-64d42d93-d94b-489e-a86d-c3462b0fca16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.154808 Jul 28 10:37:58.103267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 67/151] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:57 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:58.236593 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:58.246355 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-123ef1ef-317d-45af-8f2d-5bd9543eba85 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.159518 Jul 28 10:37:58.249061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 85/152] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:58 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:37:58.474969 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:58.476455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:58.482768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:58.483234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:58.483978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:58.484578 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:58.701227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8166f340-4c6b-44dd-b30e-b144cdafce95 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 0.229870 Jul 28 10:37:58.701996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 68/153] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:37:58 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:37:59.125281 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:59.126559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:59.136688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.137596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.139030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.139658 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.264478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:37:59.265365 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:59.272204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.273404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.274529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.275033 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.424886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:59.434146 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c71635a2-4b9e-48b3-b756-e31ef41e0dd3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.173490 Jul 28 10:37:59.434853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 69/154] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:37:59 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:37:59.439895 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-30dff403-715b-45cb-b691-ac78d1b3c18f req-6a0af05e-4b85-4100-8989-48a438321be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd28e13-6930-4641-9020-5257ca4327af", "name": "network-vif-plugged", "status": "completed", "tag": "34faabe4-239a-4508-b886-66e6cb2243a3"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:59.441476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:37:59.441476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:37:59.449803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-30dff403-715b-45cb-b691-ac78d1b3c18f req-6a0af05e-4b85-4100-8989-48a438321be8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.450568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-30dff403-715b-45cb-b691-ac78d1b3c18f req-6a0af05e-4b85-4100-8989-48a438321be8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.464157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-30dff403-715b-45cb-b691-ac78d1b3c18f req-6a0af05e-4b85-4100-8989-48a438321be8 service nova] Creating event network-vif-plugged:34faabe4-239a-4508-b886-66e6cb2243a3 for instance 6cd28e13-6930-4641-9020-5257ca4327af on hv-cinder-80043 Jul 28 10:37:59.470832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-30dff403-715b-45cb-b691-ac78d1b3c18f req-6a0af05e-4b85-4100-8989-48a438321be8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Jul 28 10:37:59.473832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 70/155] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:37:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:37:59.520940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:59.530381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:59.531796 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:37:59.532898 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4a3f7c3a-1708-4416-ad44-15a1096a1e92 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1408 microversion: 2.20 time: 0.414534 Jul 28 10:37:59.533446 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 86/156] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:37:59 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1408 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:37:59.725153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:37:59.728073 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:37:59.737363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.738096 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.739475 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:37:59.740112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:37:59.912694 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-28560fa1-0270-4f4d-b266-d2d3d737ea2b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 0.203653 Jul 28 10:37:59.914331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 71/157] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:37:59 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:38:00.450050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:00.450832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:00.456673 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.457226 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.458073 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.458587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.551777 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:00.552478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:00.559478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.560007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.560835 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.561285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.582147 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:00.590547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-aba58471-2641-4075-bb99-fd65eed6113e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.144068 Jul 28 10:38:00.591802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 87/158] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:00 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:00.637088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:00.637576 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:00.643361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.643802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.644564 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.645024 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.670442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:38:00.699762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:00.714917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:00.716425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:00.717601 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c19820b4-12df-42cd-a517-532c7c7b26cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1600 microversion: 2.20 time: 0.169897 Jul 28 10:38:00.718501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 72/159] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:38:00 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:38:00.737156 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:00.737752 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:00.743867 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.744322 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.745126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.745563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.771105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-dbf0eaf3-dab4-4be1-b04a-2a842bacc0d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 204 len: 0 microversion: 2.1 time: 0.137297 Jul 28 10:38:00.771706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 88/160] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:38:00 2021] DELETE /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:38:00.779944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:00.780648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:00.787567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.787952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.789293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.789798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.834206 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-845dfde7-e5a0-400d-bdaf-d721a4517e28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101743 Jul 28 10:38:00.841562 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 73/161] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Jul 28 10:38:00 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:00.921388 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:00.924370 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:00.925558 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:00.933510 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-eb38a9fa-1f56-4544-b3b6-e6dc41486e08 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.156347 Jul 28 10:38:00.934744 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.935605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.936577 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:00.937753 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:00.944648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 89/162] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:00 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:01.607571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:01.608248 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:01.614380 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:01.614818 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:01.615570 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:01.616000 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:01.747001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:01.754675 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b04ff70d-379b-4828-82e9-ef2641a8fd66 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.150778 Jul 28 10:38:01.755252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 90/163] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:01 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:01.950664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:01.951224 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:01.957801 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:01.958293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:01.959100 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:01.959537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:02.083649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:02.092501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1694bf6a-c4d2-4b03-ac7b-ec15d43a9179 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.145622 Jul 28 10:38:02.093115 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 91/164] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:01 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:02.171094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:02.172081 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:02.178013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:02.178451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:02.180055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:02.180485 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:03.605377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-09fa7bb6-aa04-4fc9-a76e-ecb9dbebf796 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 1.437708 Jul 28 10:38:03.606032 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 92/165] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:02 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:03.610999 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-542899ac-f7bb-4197-a8f4-13c3c99453d9 req-c26fe145-2e8b-48be-b060-33c20e2a9057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:03.612519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:03.612519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:03.620772 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-542899ac-f7bb-4197-a8f4-13c3c99453d9 req-c26fe145-2e8b-48be-b060-33c20e2a9057 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:03.621217 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-542899ac-f7bb-4197-a8f4-13c3c99453d9 req-c26fe145-2e8b-48be-b060-33c20e2a9057 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:03.631920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4501f5ca-0073-4d6c-be5c-bb915b3ad449 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 2.711895 Jul 28 10:38:03.632575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-542899ac-f7bb-4197-a8f4-13c3c99453d9 req-c26fe145-2e8b-48be-b060-33c20e2a9057 service nova] Creating event network-changed:602fc625-de40-4d7c-8ac1-0c239e6258a7 for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b on hv-cinder-80043 Jul 28 10:38:03.635561 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 74/166] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:00 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 2716 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:38:03.637051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-542899ac-f7bb-4197-a8f4-13c3c99453d9 req-c26fe145-2e8b-48be-b060-33c20e2a9057 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029624 Jul 28 10:38:03.637906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 93/167] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:03.649452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:03.649452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:03.649643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:03.649643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:03.649794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:03.649882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:03.649974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:03.650063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:03.650501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:03.650625 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:03.650930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:03.651129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:03.777601 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:03.785818 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-76c6120b-10ee-467d-a77f-855ad17f2c84 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.146981 Jul 28 10:38:03.786579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 94/168] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:03 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:03.806249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:03.813492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c13c57e3-977c-4968-b689-1eb52455ddfa tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.176551 Jul 28 10:38:03.814059 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 75/169] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:03 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:04.615318 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:04.616848 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:04.623550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.623991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.624772 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.625233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.642497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:04.643404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:04.649604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.651508 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.651508 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.651508 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.905335 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-36799f6f-4326-46d0-906e-71e31347bc2e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.293321 Jul 28 10:38:04.906193 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 95/170] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:04 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:04.911129 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:04.911822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:04.919028 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.919472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.920233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.920668 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.934761 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f894e635-4a84-4f53-a063-14e004bcc86b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 14 microversion: 2.1 time: 0.295687 Jul 28 10:38:04.937968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 76/171] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:04 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 14 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:38:04.940092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:04.940797 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:04.947170 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.947612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:04.948368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:04.948918 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:05.048698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:05.057492 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-77a38f9c-74dd-4956-a44f-3b5cd5274147 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.149934 Jul 28 10:38:05.058102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 96/172] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:04 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:05.096560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:05.104182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d1f3dbf9-75d4-4572-832e-98fdbc1c4715 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1322 microversion: 2.1 time: 0.167706 Jul 28 10:38:05.104741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 77/173] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:04 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:05.916229 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:05.917121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:05.923310 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:05.923758 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:05.924525 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:05.924993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:05.945963 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:05.946881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:05.954932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:05.955385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:05.956159 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:05.956593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.046788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f3f19167-62d8-48df-9a11-d7f8badf65a4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.134910 Jul 28 10:38:06.047432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 97/174] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:05 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:06.074406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:06.075105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:06.081782 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.082233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.083002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.083442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.205195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:06.213457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2614a1a1-1017-41b7-923f-42ae89816da5 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.142755 Jul 28 10:38:06.214025 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 98/175] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:06 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:06.218518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:06.219125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:06.224470 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.224956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.226341 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.226947 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.344564 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:06.352417 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-133fb40a-cb1b-4682-8616-431a237fbe17 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1516 microversion: 2.1 time: 0.137459 Jul 28 10:38:06.353017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 99/176] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:06 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1516 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:06.368324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:06.369268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:06.375095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.375553 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.376311 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.376768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.399387 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lazy-loading 'flavor' on Instance uuid 6cd28e13-6930-4641-9020-5257ca4327af {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:38:06.505904 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7592085f-47b2-4b6d-8865-543c5f6975ed tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af/action" status: 200 len: 32 microversion: 2.1 time: 0.140933 Jul 28 10:38:06.506499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 100/177] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:06 2021] POST /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:38:06.515884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:06.516645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:06.522857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.523769 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.524528 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:06.525055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:06.649236 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:06.656834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-549c0a12-243a-4784-ae38-57dd9dbc8103 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.144648 Jul 28 10:38:06.657415 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 101/178] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:06 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:07.058574 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:07.059483 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:07.065364 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:07.065808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:07.066598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:07.067029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:09.409612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5f546b54-d51f-41e1-aae4-1e18148eda32 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 6451 microversion: 2.1 time: 3.467336 Jul 28 10:38:09.410344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 78/179] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:05 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 6451 bytes in 3469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:09.415214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:09.415884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:09.424762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:09.425606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:09.426992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:09.427795 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:09.553930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:09.562095 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a2a1092f-5ce8-477f-add3-aa069c3967d0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.150658 Jul 28 10:38:09.562998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 79/180] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:09 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:09.567302 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:09.567910 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:09.574417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:09.574876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:09.575768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:09.576211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:09.595400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1d29c42e-c30a-4d8e-bbc9-67368efad49d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 2.541253 Jul 28 10:38:09.598874 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 102/181] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:07 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:09.772177 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:09.779424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-60da099e-bd01-4e0b-aea4-e441ba2a8fbd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.215484 Jul 28 10:38:09.779983 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 80/182] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:09 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:10.421114 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:10.422105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:10.429350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.429794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.430555 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.431053 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.579337 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:10.579961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:10.587130 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.587629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.588464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.588939 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.597584 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-11905573-6663-4a3e-8c99-70a32024c911 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 13379 microversion: 2.1 time: 0.180176 Jul 28 10:38:10.598825 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 103/183] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:10 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 13379 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:10.606183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:10.607769 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:10.615624 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.616067 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.617195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.618014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.718734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:10.726931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-21018bae-b39b-4ebc-a35c-f477fe888a65 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1552 microversion: 2.1 time: 0.151453 Jul 28 10:38:10.727498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 81/184] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:10 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:10.796652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:10.797294 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:10.803036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.804037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.804817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:10.805250 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:10.835993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-15d44086-ac59-4052-8e14-b0acc1dd5fec tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.233743 Jul 28 10:38:10.839063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 104/185] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:10 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:10.936894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:10.944376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8c19db9e-4f51-43ad-a438-3eb4d29c3513 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.151186 Jul 28 10:38:10.944961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 82/186] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:10 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:11.611132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:11.612166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:11.620275 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.620715 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.622112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.622798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.744296 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:11.745194 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:11.751746 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.752442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.753258 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.753696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.764887 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b7bb2feb-d1d9-486b-b7e9-eabf5ec36e19 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 15651 microversion: 2.1 time: 0.157608 Jul 28 10:38:11.765643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 105/187] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:11 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 15651 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:11.847085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:11.848370 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:11.855630 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.856082 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.856924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.857375 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.938102 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:11.947434 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-06c882cf-42d0-4761-bc2c-7d7be1c08f70 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1510 microversion: 2.1 time: 0.207716 Jul 28 10:38:11.948106 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 83/188] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:11 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:11.963763 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:11.964468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:11.971953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.972405 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:11.973205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:11.973643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:12.017674 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a1d8b71a-a8f7-4cbb-80ac-00218ddd8aee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.174446 Jul 28 10:38:12.018794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 106/189] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:11 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:12.024428 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-d6108ca1-aec4-42ee-b664-e455c43f5a4d req-6194e9ec-180c-4d4a-b06c-d9e8a32e2cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1", "name": "network-vif-deleted", "tag": "122754f7-f4c7-428b-a951-12c2330d6835"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:12.025922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:12.025922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:12.033594 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-d6108ca1-aec4-42ee-b664-e455c43f5a4d req-6194e9ec-180c-4d4a-b06c-d9e8a32e2cca service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:12.034039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-d6108ca1-aec4-42ee-b664-e455c43f5a4d req-6194e9ec-180c-4d4a-b06c-d9e8a32e2cca service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:12.048837 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-d6108ca1-aec4-42ee-b664-e455c43f5a4d req-6194e9ec-180c-4d4a-b06c-d9e8a32e2cca service nova] Creating event network-vif-deleted:122754f7-f4c7-428b-a951-12c2330d6835 for instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 on hv-cinder-80043 Jul 28 10:38:12.053838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-d6108ca1-aec4-42ee-b664-e455c43f5a4d req-6194e9ec-180c-4d4a-b06c-d9e8a32e2cca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Jul 28 10:38:12.054705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 107/190] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:12.105725 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:12.114931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f4f287f4-4fc5-4fc3-a581-49eb9a48f572 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.156453 Jul 28 10:38:12.123581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 84/191] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:11 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:12.778446 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:12.779432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:12.785288 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:12.785729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:12.786479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:12.786906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:12.944853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-29ef5ffe-0121-40ba-95d4-42fff1371b71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 17629 microversion: 2.1 time: 0.169864 Jul 28 10:38:12.945367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 108/192] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:12 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 17629 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:12.965379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:12.966156 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:12.972366 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:12.972850 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:12.973606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:12.974048 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.006310 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.006937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.007521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lazy-loading 'fault' on Instance uuid b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:38:13.030993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:13.032910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:13.043695 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.044431 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.045445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.046055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.059223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c525549e4c5d41f49ce25b05c574c45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8272e15ff3f54906846a9da0f16b95ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:13.069770 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a0f75ac6-83d9-455d-8676-bf962c2ebc34 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 200 len: 1349 microversion: 2.1 time: 0.107888 Jul 28 10:38:13.070576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 85/193] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:12 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:13.132106 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:13.133007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:13.139633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.140363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.141478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.142159 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.152507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b9abedd3-e647-4a68-b58d-bb8bbe1f075c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.125875 Jul 28 10:38:13.152655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 109/194] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:13 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:13.361380 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:13.369358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-29e46599-41cd-4d68-8885-a9f86867798b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.241046 Jul 28 10:38:13.369950 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 86/195] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:13 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:13.405465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-289928790", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "62d4883f-dea5-4f88-8684-dde642b6cfa0"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:13.475709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] validate_networks() for [('62d4883f-dea5-4f88-8684-dde642b6cfa0', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:38:13.957538 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:13.958782 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:13.967658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.968992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:13.970205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:13.970870 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.019278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:14.019886 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:14.020733 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:14.021480 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:14.022653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:14.031744 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.032186 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.033201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.033854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.051798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:14.056715 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for user 39dc329d6654473e869f8892dbb3e046 and project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:14.069773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:38:14.072550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:38:14.095980 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d7e3d6b0-3e00-4042-bffe-54bfba7ad594 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 18509 microversion: 2.1 time: 0.143497 Jul 28 10:38:14.096725 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 87/196] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:13 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 18509 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:14.107733 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:14.109309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:14.138240 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-108743c7-1640-4c2d-97df-8abb107214ca tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737268 Jul 28 10:38:14.138514 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.139004 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.139656 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 110/197] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:38:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:38:14.139804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.140355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.151695 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c36f5fb3-4c7e-46d2-8bb1-565b5ffad99b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:14.152315 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c36f5fb3-4c7e-46d2-8bb1-565b5ffad99b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:14.168207 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] HTTP exception thrown: Instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 could not be found. Jul 28 10:38:14.168841 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Returning 404 to user: Instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:14.169862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b31ad3b8-2cb0-4dbe-8d71-1c0834a985b0 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 404 len: 111 microversion: 2.1 time: 0.066792 Jul 28 10:38:14.175126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 88/198] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:14 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:14.181380 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:14.182585 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:14.189790 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.190779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.191800 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.192464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.263882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c36f5fb3-4c7e-46d2-8bb1-565b5ffad99b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:14.274094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c36f5fb3-4c7e-46d2-8bb1-565b5ffad99b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1217 microversion: 2.1 time: 0.128473 Jul 28 10:38:14.275865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 111/199] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:14 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:14.316693 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fa4d2592-085f-4c16-97c2-99c72ebad7ad tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.139879 Jul 28 10:38:14.317514 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 89/200] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:14 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:14.388254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:14.389346 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:14.399450 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.400408 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.401986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:14.402583 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:14.642781 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:14.653985 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-95ae905d-6caa-4139-94b2-e1886ea93601 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.269931 Jul 28 10:38:14.655214 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 112/201] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:14 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:15.107890 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:15.108934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:15.115670 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.116992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.117852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.118305 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.243435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3d4d714f-25f7-4511-baa7-e30b537e3aec tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 20756 microversion: 2.1 time: 0.139493 Jul 28 10:38:15.244441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 90/202] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:15 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 20756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:15.298891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:15.300632 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:15.311913 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.312428 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.313494 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.314139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.328519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:15.329977 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:15.339805 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.340288 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.341090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.341512 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.423117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:15.434990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a0867844-8d96-4edc-8c65-88e03cc259fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1269 microversion: 2.1 time: 0.145684 Jul 28 10:38:15.445241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 113/203] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:15 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:15.567119 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-94d94252-d0c0-47cf-8087-e0008719ba7b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.243038 Jul 28 10:38:15.567885 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 91/204] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:15 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:15.678031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:15.679787 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:15.679921 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:15.680656 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:15.688670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.689342 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.692683 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.693325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.698519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.701358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.705573 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.706268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.742631 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] HTTP exception thrown: Instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 could not be found. Jul 28 10:38:15.744652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Returning 404 to user: Instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:15.746952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f51632a6-32d6-4810-889c-f32e8c1c4871 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 404 len: 111 microversion: 2.1 time: 0.075782 Jul 28 10:38:15.752710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 92/205] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:38:15 2021] DELETE /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:15.764322 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:15.766894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] [instance: b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:15.780331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.780696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.781515 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:15.781956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:15.806810 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] HTTP exception thrown: Instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 could not be found. Jul 28 10:38:15.807678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] Returning 404 to user: Instance b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:15.808822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d80ed9dd-5a7b-4cc1-8151-68ba2a2c9629 tempest-DeleteServersTestJSON-1181293951 tempest-DeleteServersTestJSON-1181293951-project] 10.222.0.25 "GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1" status: 404 len: 111 microversion: 2.1 time: 0.054897 Jul 28 10:38:15.809548 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 93/206] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:15 2021] GET /compute/v2.1/servers/b8dff4c5-6e9c-4dfe-a44d-b2500f65b5e1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:15.993948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:16.004910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0b1ba686-f351-46a0-8d23-24947a86313b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.335015 Jul 28 10:38:16.015750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 114/207] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:15 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:16.257724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:16.259532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:16.274767 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:16.275884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:16.276966 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:16.278435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:16.456683 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bdb043cc-bc6f-49fb-8580-502157938d08 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 22118 microversion: 2.1 time: 0.203079 Jul 28 10:38:16.456929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:16.457506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:16.462344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 94/208] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:16 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 22118 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:16.467961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:16.470592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:16.477871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:16.478327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:16.579130 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:16.580341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:16.584617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:16.587426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:16.588080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:16.589037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:16.589652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:16.595365 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-34983ef8-b653-47b1-98b5-e851e1525943 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1275 microversion: 2.1 time: 0.141763 Jul 28 10:38:16.596825 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 115/209] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:16 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1275 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:16.695854 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a25937ed-a2eb-495f-9dd2-fa3db4615cc9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.120290 Jul 28 10:38:16.697456 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 95/210] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:16 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:17.024011 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:17.025369 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:17.034290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.040095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.041600 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.042267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.472631 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:17.473678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:17.483803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.484273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.485737 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.486179 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.575041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:17.582556 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f076707e-8d19-41e9-9de8-237c2cc61e20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.563989 Jul 28 10:38:17.592220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 116/211] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:17 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:17.614412 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:17.615089 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:17.625111 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.625569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.626358 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.626786 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.643017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9beceea7-3a5d-418d-a58f-69b0afbd3c37 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 23229 microversion: 2.1 time: 0.177397 Jul 28 10:38:17.644083 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 96/212] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:17 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 23229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:17.708473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:17.710339 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:17.719866 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.721183 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.722215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:17.723142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:17.846368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f16ec4a7-b903-4272-bc67-bc1e7fecd72b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 14 microversion: 2.20 time: 0.141975 Jul 28 10:38:17.849544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 97/213] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:17 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:18.032857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:18.055773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e0b4448d-7688-4c03-95a0-66fca092b397 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.436513 Jul 28 10:38:18.055773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 117/214] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:17 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:18.294238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-fe2e9be5-c804-42a2-9e55-48be3a79b96a req-f1ae2bf2-755d-472a-a8c9-6df7aef8885b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada72fe7-516f-4e03-92b1-c5112f8ca0d9", "tag": "7ead3efc-6e34-4e14-a0fb-2e8dcbf09a18"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:18.297911 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:18.297911 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:38:18.311981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-fe2e9be5-c804-42a2-9e55-48be3a79b96a req-f1ae2bf2-755d-472a-a8c9-6df7aef8885b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.312519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-fe2e9be5-c804-42a2-9e55-48be3a79b96a req-f1ae2bf2-755d-472a-a8c9-6df7aef8885b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.326191 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-fe2e9be5-c804-42a2-9e55-48be3a79b96a req-f1ae2bf2-755d-472a-a8c9-6df7aef8885b service nova] Creating event network-changed:7ead3efc-6e34-4e14-a0fb-2e8dcbf09a18 for instance ada72fe7-516f-4e03-92b1-c5112f8ca0d9 on hv-cinder-80043 Jul 28 10:38:18.331197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-fe2e9be5-c804-42a2-9e55-48be3a79b96a req-f1ae2bf2-755d-472a-a8c9-6df7aef8885b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044769 Jul 28 10:38:18.331791 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 98/215] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:18.599411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:18.601766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:18.612039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.612801 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.615041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.617350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.662067 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:18.666150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:18.675004 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.676010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.677257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.678473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.818521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:18.825395 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-debc0ead-fea8-455f-8714-cc861d959fd5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 23798 microversion: 2.1 time: 0.171714 Jul 28 10:38:18.826557 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3b0a51bd-3d08-48af-98dc-18e53f904fc0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.230977 Jul 28 10:38:18.826832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 99/216] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:18 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 23798 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:18.835931 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 118/217] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:18 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:18.859704 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:18.861100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:18.870196 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.871030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.872016 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:18.873027 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:18.999821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9aa4cbad-0930-48a2-bcc4-973b5ea35792 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 3392 microversion: 2.20 time: 0.145161 Jul 28 10:38:19.000850 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 100/218] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:18 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 3392 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:38:19.066539 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:19.067161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:19.075876 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:19.076829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:19.078338 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:19.079367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:19.284557 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:19.293437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f9b8309e-e451-42da-9bbd-c440188f63e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.232783 Jul 28 10:38:19.304197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 119/219] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:19 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:19.324952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-768966708", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "2871a1c5-4cd2-4ce6-8e19-558dcce5feb3"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:19.389147 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] validate_networks() for [('2871a1c5-4cd2-4ce6-8e19-558dcce5feb3', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:38:19.403027 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8aadfc77-397f-4b95-a063-ea7382bf023b tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Action: 'create', calling method: .version_select at 0x7fe47c15e670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-620264667", "metadata": {"Type": "work"}}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:19.404560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8aadfc77-397f-4b95-a063-ea7382bf023b tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:19.405333 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8aadfc77-397f-4b95-a063-ea7382bf023b tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.209378 Jul 28 10:38:19.406274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 101/220] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Jul 28 10:38:19 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:38:19.417254 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a5b00c77-6542-4075-8734-dfb262b67dd7 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Action: 'create', calling method: .version_select at 0x7fe47c119280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1718876964", "metadata": {"Type": "work"}}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:19.419847 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a5b00c77-6542-4075-8734-dfb262b67dd7 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:19.422364 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a5b00c77-6542-4075-8734-dfb262b67dd7 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011002 Jul 28 10:38:19.425655 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 102/221] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Jul 28 10:38:19 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:38:19.437140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-25628ce6-a4f9-4f29-bdb9-eb339db0624e tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Action: 'create', calling method: .version_select at 0x7fe47cabfe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-450768306", "metadata": {"Type": "work"}}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:19.439131 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-25628ce6-a4f9-4f29-bdb9-eb339db0624e tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:19.440159 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-25628ce6-a4f9-4f29-bdb9-eb339db0624e tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007397 Jul 28 10:38:19.441380 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 103/222] 10.222.0.25 () {60 vars in 1156 bytes} [Wed Jul 28 10:38:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:38:19.452653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ce90bce2-b9c6-471a-bb4c-9fb59e672efb tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Calling method '.version_select at 0x7fe47caa6700>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:19.491151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-ce90bce2-b9c6-471a-bb4c-9fb59e672efb tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] HTTP exception thrown: Volume tempest-invalid-1850796804 could not be found. Jul 28 10:38:19.491879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ce90bce2-b9c6-471a-bb4c-9fb59e672efb tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Returning 404 to user: Volume tempest-invalid-1850796804 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:19.493563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ce90bce2-b9c6-471a-bb4c-9fb59e672efb tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1850796804" status: 404 len: 99 microversion: 2.1 time: 0.045895 Jul 28 10:38:19.494130 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 104/223] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Jul 28 10:38:19 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1850796804 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:38:19.504522 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-42656432-acbe-4a6d-b1ec-8de5dd95ed11 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005003 Jul 28 10:38:19.505820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 105/224] 10.222.0.25 () {58 vars in 1140 bytes} [Wed Jul 28 10:38:19 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 10:38:19.515369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-da1c111e-5089-449f-8443-645bd3af1f24 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003932 Jul 28 10:38:19.516233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 106/225] 10.222.0.25 () {58 vars in 1137 bytes} [Wed Jul 28 10:38:19 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 10:38:19.525807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7c94f6eb-7557-4bdf-9485-6ab728466395 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Calling method '.version_select at 0x7fe47caa6ca0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:19.567291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-7c94f6eb-7557-4bdf-9485-6ab728466395 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] HTTP exception thrown: Volume c27c9c76-b9ec-4ca0-b092-6b6546375547 could not be found. Jul 28 10:38:19.567901 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7c94f6eb-7557-4bdf-9485-6ab728466395 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Returning 404 to user: Volume c27c9c76-b9ec-4ca0-b092-6b6546375547 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:19.569647 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7c94f6eb-7557-4bdf-9485-6ab728466395 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/c27c9c76-b9ec-4ca0-b092-6b6546375547" status: 404 len: 109 microversion: 2.1 time: 0.047369 Jul 28 10:38:19.570417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 107/226] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Jul 28 10:38:19 2021] DELETE /compute/v2.1/os-volumes/c27c9c76-b9ec-4ca0-b092-6b6546375547 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:38:19.579741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-efbb40bb-1e0d-48e9-8f1b-9eab6aef7de5 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Calling method '.version_select at 0x7fe47c119430>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:19.610340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-efbb40bb-1e0d-48e9-8f1b-9eab6aef7de5 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] HTTP exception thrown: Volume 2955901b-53c2-49f3-9912-22d1ad1de791 could not be found. Jul 28 10:38:19.611638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-efbb40bb-1e0d-48e9-8f1b-9eab6aef7de5 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] Returning 404 to user: Volume 2955901b-53c2-49f3-9912-22d1ad1de791 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:19.612492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-efbb40bb-1e0d-48e9-8f1b-9eab6aef7de5 tempest-VolumesNegativeTest-1491235248 tempest-VolumesNegativeTest-1491235248-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2955901b-53c2-49f3-9912-22d1ad1de791" status: 404 len: 109 microversion: 2.1 time: 0.036395 Jul 28 10:38:19.622167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 108/227] 10.222.0.25 () {58 vars in 1245 bytes} [Wed Jul 28 10:38:19 2021] GET /compute/v2.1/os-volumes/2955901b-53c2-49f3-9912-22d1ad1de791 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:38:19.839760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:19.841117 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:19.854295 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:19.861431 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:19.862252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:19.862692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:19.864416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:19.864914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:19.865442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:19.866467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:19.866976 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:19.882204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:19.882720 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:19.883533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:19.888547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:19.927352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Getting quotas for project 302ffd5aee604675b6633eb88efb3dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:19.935805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Getting quotas for user 287bf80d7a0d49e4a049c76ba95ebafd and project 302ffd5aee604675b6633eb88efb3dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:19.949602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:38:19.952468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:38:20.001818 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ca24a8b1-e125-4a07-8f51-ade6dc2358c8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 25021 microversion: 2.1 time: 0.166474 Jul 28 10:38:20.002544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 109/228] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:19 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 25021 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:20.012249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.013336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:20.021746 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9c5abcf5-3fe0-43ed-b77e-cdbb94b775b9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700251 Jul 28 10:38:20.023989 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 120/229] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:38:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:38:20.031031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:20.032438 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:20.036481 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:20.036983 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:20.041356 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:20.042041 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:20.066745 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:20.067468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:20.068635 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:20.073719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:20.251265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c6a3540f-d6d1-4228-b3c5-6e070ba6f880 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 7865 microversion: 2.20 time: 0.225539 Jul 28 10:38:20.251908 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 121/230] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:20 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 7865 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:38:20.263739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d2b2c181-0a46-417d-9559-f29979dbd032 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.264652 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d2b2c181-0a46-417d-9559-f29979dbd032 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:20.367621 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d2b2c181-0a46-417d-9559-f29979dbd032 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:20.390781 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d2b2c181-0a46-417d-9559-f29979dbd032 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1213 microversion: 2.1 time: 0.136901 Jul 28 10:38:20.393064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 122/231] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:20 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:20.403909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:20.404697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:20.412156 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:20.413824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:20.415001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:20.415859 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:20.552862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:20.565537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a6648798-50ce-43fb-9e6a-4f52f42bdcac tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.561424 Jul 28 10:38:20.566687 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 110/232] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:20 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:20.755686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:20.765023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3153f9ee-0ce8-4dde-a843-12211b126398 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.370645 Jul 28 10:38:20.765840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 123/233] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:20 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:21.014134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:21.015548 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:21.041910 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.043010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.045134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.045945 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.195951 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-20dcab8d-fb73-430f-9382-7f71e2dea18e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 25599 microversion: 2.1 time: 0.185917 Jul 28 10:38:21.196869 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 111/234] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:21 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 25599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:21.265852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:21.267521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:21.275296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.276792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.277940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.279869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.410865 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:21.412165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:21.427076 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.428765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.430454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.433320 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b320caa6-7992-42ba-a5f5-456b5e4597ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 12286 microversion: 2.20 time: 0.173831 Jul 28 10:38:21.434065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.434326 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 124/235] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:21 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 12286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:21.583655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:21.585085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:21.600972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:21.611305 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.611850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.613380 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.613934 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.626110 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e0540b95-9eaf-4404-8dc4-1f295c1fd353 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1265 microversion: 2.1 time: 0.220611 Jul 28 10:38:21.627547 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 112/236] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:21 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:21.785906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:21.786749 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:21.808878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:21.813683 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.814039 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.814818 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:21.815275 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:21.825952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2b0745d0-9b87-4e30-bd1e-5993332f0200 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.245731 Jul 28 10:38:21.828332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 125/237] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:21 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:22.139603 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:22.150959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2e1febe7-ee00-4b1c-9510-c24979552c02 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.368683 Jul 28 10:38:22.155952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 113/238] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:21 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:22.207474 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:22.208484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:22.220445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.224451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.226296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.226745 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.368036 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3e845eff-912f-4b83-9e47-cc93ff9a1c4f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 26302 microversion: 2.1 time: 0.164028 Jul 28 10:38:22.372910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 126/239] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:22 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 26302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:22.446944 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:22.448366 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:22.464954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.467030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.468776 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.471849 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.601101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c8a72d94-73ac-4b6d-9d19-2440c86a9fb2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 15283 microversion: 2.20 time: 0.158696 Jul 28 10:38:22.605249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 114/240] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:22 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 15283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:22.646158 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:22.647062 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:22.663837 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.664123 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.667128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.667585 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.789030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:22.796779 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e31721a1-4ef6-49b4-83c4-7525f3a27ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1271 microversion: 2.1 time: 0.155108 Jul 28 10:38:22.797382 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 127/241] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:22 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:22.851662 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:22.853386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:22.874238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.874834 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:22.877164 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:22.877844 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.169585 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:23.170367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:23.182321 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.183300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.187234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.189308 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.432796 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:23.448829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f4001115-a52b-4333-8ce6-f14953a64213 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.280545 Jul 28 10:38:23.450257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 128/242] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:23 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:23.457123 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:23.464770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:23.478495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.479677 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.493404 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.494229 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.629293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:23.649966 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-11f48f8a-7709-4aab-88a6-2e80647f2fc5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.804032 Jul 28 10:38:23.654017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4df0f828-05ed-4d40-b4bf-f36770a2ff5b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 27011 microversion: 2.1 time: 0.201475 Jul 28 10:38:23.655595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 129/243] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:23 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 27011 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:23.661690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 115/244] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:22 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:23.669520 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:23.674145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:23.692950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.693699 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.694685 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.702103 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.816192 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:23.817035 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:23.830909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.831379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.832188 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:23.832620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:23.908533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3551d97e-b66f-4057-bd27-3ebf13474f68 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 17931 microversion: 2.20 time: 0.250618 Jul 28 10:38:23.909441 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 130/245] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:23 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 17931 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:24.148506 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:24.161010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-003008ff-82ab-48ac-8106-eb64edb810e7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.349070 Jul 28 10:38:24.162008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 116/246] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:23 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:24.294050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-3bc81b41-6d8f-412d-a514-5804d2ccc7fa req-f2f8b58d-2563-4a8d-bfcc-21f945615b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "713a603f-c5ec-4fef-bb27-071aa8601e5c", "tag": "65a0589d-0df9-4460-8592-67b5a197a706"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:24.295562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:24.295562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:24.309475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-3bc81b41-6d8f-412d-a514-5804d2ccc7fa req-f2f8b58d-2563-4a8d-bfcc-21f945615b8b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.309928 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-3bc81b41-6d8f-412d-a514-5804d2ccc7fa req-f2f8b58d-2563-4a8d-bfcc-21f945615b8b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:24.334920 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-3bc81b41-6d8f-412d-a514-5804d2ccc7fa req-f2f8b58d-2563-4a8d-bfcc-21f945615b8b service nova] Creating event network-changed:65a0589d-0df9-4460-8592-67b5a197a706 for instance 713a603f-c5ec-4fef-bb27-071aa8601e5c on hv-cinder-80043 Jul 28 10:38:24.339664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-3bc81b41-6d8f-412d-a514-5804d2ccc7fa req-f2f8b58d-2563-4a8d-bfcc-21f945615b8b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049576 Jul 28 10:38:24.343117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 131/247] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:24.466180 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:24.467029 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:24.474298 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.476171 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:24.477312 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.477999 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:24.668574 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:24.669295 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:24.680065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.683253 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:24.684933 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.685665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:24.829080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:24.846464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-da61bfaa-f2cf-4486-88f0-48a18007a2dc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.384088 Jul 28 10:38:24.847911 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 117/248] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:24 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:24.855286 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:24.857115 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:24.864177 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.864632 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:24.865563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:24.866036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.056349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e3714c0e-8ad5-44a3-9561-cc8b9a1d078b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 27473 microversion: 2.1 time: 0.204986 Jul 28 10:38:25.058165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 118/249] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:24 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 27473 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:25.071461 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:25.073738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:25.087799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.088479 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.090855 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.091498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.358088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-96fa19c4-a605-4c73-8743-387e50ba6a95 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 19342 microversion: 2.20 time: 0.296112 Jul 28 10:38:25.366619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 119/250] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:25 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 19342 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:25.389834 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:25.393291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:25.407936 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.408675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.410335 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.411584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.618758 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:25.646183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b835b951-bc8c-4342-873f-e3943f685301 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.981257 Jul 28 10:38:25.648121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 132/251] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:24 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:25.684426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-24df2bc4-0e5b-49f6-be9a-952d93343fd1 req-e5351202-e12e-492a-ac47-2ec511b22ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada72fe7-516f-4e03-92b1-c5112f8ca0d9", "name": "network-vif-plugged", "status": "completed", "tag": "7ead3efc-6e34-4e14-a0fb-2e8dcbf09a18"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:25.686929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:25.686929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:25.713260 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-24df2bc4-0e5b-49f6-be9a-952d93343fd1 req-e5351202-e12e-492a-ac47-2ec511b22ed4 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.713758 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-24df2bc4-0e5b-49f6-be9a-952d93343fd1 req-e5351202-e12e-492a-ac47-2ec511b22ed4 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.737565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-24df2bc4-0e5b-49f6-be9a-952d93343fd1 req-e5351202-e12e-492a-ac47-2ec511b22ed4 service nova] Creating event network-vif-plugged:7ead3efc-6e34-4e14-a0fb-2e8dcbf09a18 for instance ada72fe7-516f-4e03-92b1-c5112f8ca0d9 on hv-cinder-80043 Jul 28 10:38:25.746401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-24df2bc4-0e5b-49f6-be9a-952d93343fd1 req-e5351202-e12e-492a-ac47-2ec511b22ed4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080948 Jul 28 10:38:25.748007 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 133/252] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:25.864271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:25.865139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:25.871968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.872337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.873473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:25.873905 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:25.963736 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:25.983906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fe4c2a68-4640-4830-9b78-db57ea53c4d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.615896 Jul 28 10:38:25.984494 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 120/253] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:25 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:26.070862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:26.072647 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:26.088667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:26.089374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:26.090313 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:26.090926 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:26.253373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cc081f04-717e-4872-8f45-4044c2543fca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 27692 microversion: 2.1 time: 0.186716 Jul 28 10:38:26.263538 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 121/254] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:26 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 27692 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:26.288929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:26.300090 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1370b412-0738-44f0-bedd-ae8139bf204c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.439957 Jul 28 10:38:26.307179 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 134/255] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:25 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:26.375327 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:26.377563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:26.386820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:26.387546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:26.389214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:26.389932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:26.664057 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:26.664890 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:26.671379 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:26.672014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:26.673051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:26.673634 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:26.725111 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-523e0a51-51ba-4795-8d0e-afd8e49135ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 22113 microversion: 2.20 time: 0.354481 Jul 28 10:38:26.728692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 122/256] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:26 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 22113 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:26.882632 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:26.897199 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-25b8bebf-98bf-4fdd-8211-9c3c4fd383e8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.234741 Jul 28 10:38:26.901242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 135/257] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:26 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:27.004223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:27.005324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:27.013176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.014410 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.015363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.015955 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.182847 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:27.193375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-71496a4f-1fb2-4d55-b557-de34eb67d0fb tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.194339 Jul 28 10:38:27.203241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 123/258] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:26 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:27.268246 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:27.269204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:27.281873 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.282874 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.286643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.289219 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.317819 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:27.319204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:27.332051 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.332557 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.335959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.336552 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.469952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1d608410-e3c5-480d-b40a-acde219341d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28126 microversion: 2.1 time: 0.207055 Jul 28 10:38:27.470962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 136/259] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:27 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28126 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:27.559637 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:27.568309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3c150d04-eead-42be-bb96-89b415f94937 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1317 microversion: 2.1 time: 0.254115 Jul 28 10:38:27.570630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 124/260] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:27 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:27.738577 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:27.739664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:27.751132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.754696 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.758128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.758648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.915754 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:27.920268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-73f0b835-5cca-462c-8675-8a0c1ccda86a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 23220 microversion: 2.20 time: 0.185618 Jul 28 10:38:27.924408 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 137/261] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:27 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 23220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:27.924558 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:27.950129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.950499 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:27.954595 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:27.957393 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.182712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:28.190179 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bf1801f5-3e6d-4834-9221-53021e4349c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.279928 Jul 28 10:38:28.197212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 125/262] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:27 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:28.211734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:28.212790 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:28.220009 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.220711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.221891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.222500 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.483882 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:28.486344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:28.493729 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.494436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.495761 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.496861 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.537972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:28.556022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4a97c1da-ec54-4762-a28d-53c20805693f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.348707 Jul 28 10:38:28.556619 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 138/263] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:28 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:28.586811 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:28.587439 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:28.593693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.594355 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.595458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.596032 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.637169 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-be394da1-0c1a-4b6e-a92a-c401757427b0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28126 microversion: 2.1 time: 0.156957 Jul 28 10:38:28.638783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 126/264] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:28 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28126 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:28.861897 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:28.872117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cf37e1a5-c361-4f18-8dda-18e6f83f44e2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1507 microversion: 2.1 time: 0.289644 Jul 28 10:38:28.873303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 139/265] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:28 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:28.897905 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c921b937-6d5b-41af-b555-31025931f072"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:28.901443 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:28.910581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.911381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.912389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.912855 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.932151 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:28.933162 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:28.963357 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.963817 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:28.967897 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:28.968595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.031112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] HTTP exception thrown: Invalid volume: volume c921b937-6d5b-41af-b555-31025931f072 is already attached to instances: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 Jul 28 10:38:29.031711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Returning 400 to user: Invalid volume: volume c921b937-6d5b-41af-b555-31025931f072 is already attached to instances: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:29.032556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a605c4dd-b7c9-41ca-967d-0194ed7e8176 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145900 Jul 28 10:38:29.043698 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 127/266] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:38:28 2021] POST /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:38:29.094430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c9185b1f-af4f-40b5-ba52-2ee7b6390083 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 24354 microversion: 2.20 time: 0.166015 Jul 28 10:38:29.098809 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 140/267] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:28 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 24354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:29.111667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:29.112469 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:29.121209 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.122361 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.124001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.124493 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.292032 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lazy-loading 'services' on Instance uuid 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:38:29.386951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f90b1d2b-5d12-4358-a978-76e5b8e46150 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Action: 'create', calling method: .version_select at 0x7fe47c11e3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2018612799"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:29.413100 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-f90b1d2b-5d12-4358-a978-76e5b8e46150 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Getting quotas for project 02a445a74e104a019c3d28d3f69fa4b3. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:29.417613 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-f90b1d2b-5d12-4358-a978-76e5b8e46150 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Getting quotas for user f8f6c76e08d7451c925dfb6654ff0031 and project 02a445a74e104a019c3d28d3f69fa4b3. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:29.431722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-06a421c3-94f3-457f-8f8f-7e4d923656ab tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3/os-volume_attachments/c921b937-6d5b-41af-b555-31025931f072" status: 202 len: 0 microversion: 2.1 time: 0.324327 Jul 28 10:38:29.432864 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 128/268] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:38:29 2021] DELETE /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3/os-volume_attachments/c921b937-6d5b-41af-b555-31025931f072 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:29.438083 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:29.446452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:29.455503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.456303 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.457324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.457960 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.534052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-f90b1d2b-5d12-4358-a978-76e5b8e46150 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Getting quotas for project 02a445a74e104a019c3d28d3f69fa4b3. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:29.538646 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-f90b1d2b-5d12-4358-a978-76e5b8e46150 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Getting quotas for user f8f6c76e08d7451c925dfb6654ff0031 and project 02a445a74e104a019c3d28d3f69fa4b3. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:29.562798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f90b1d2b-5d12-4358-a978-76e5b8e46150 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.377605 Jul 28 10:38:29.563921 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 141/269] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Jul 28 10:38:29 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:29.598474 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:29.600432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:29.610185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.610944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.612468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.613126 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.667108 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:29.676816 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f33a6586-830f-4298-944e-018fa437a08a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.240729 Jul 28 10:38:29.676816 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 129/270] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:29 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:29.682282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:29.683524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:29.690179 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.690676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.691464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:29.691914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:29.796281 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:29.823680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-63118895-4b10-4675-8037-3e9327ca72ca tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.253317 Jul 28 10:38:29.825045 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 142/271] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:29 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:29.834725 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8fff25a2-a1e1-4c32-8690-afac7f6dd8fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28377 microversion: 2.1 time: 0.157375 Jul 28 10:38:29.836251 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 130/272] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:29 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28377 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:30.105599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:30.106518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:30.112644 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.113339 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.114337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.115098 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.253248 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5cb0494e-5627-4eea-a17e-a9d8c1551ad6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 25213 microversion: 2.20 time: 0.151060 Jul 28 10:38:30.258435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 143/273] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:30 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 25213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:30.697636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:30.698626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:30.705597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.706318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.707292 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.707919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.841519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:30.842771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:30.851909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.852622 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.853653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.854271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.908060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:30.918067 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1667da63-e493-40dc-b600-37dace824db4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.224653 Jul 28 10:38:30.918832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 131/274] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:30 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:30.924213 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:30.928226 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:30.938132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.941983 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:30.944201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:30.946878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:31.029061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:31.037209 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d977c86f-7ec6-4532-bc5a-25046f055013 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.200077 Jul 28 10:38:31.038059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 144/275] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:30 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:31.087200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3587506e-54db-42f0-a252-31193a1ec281 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28415 microversion: 2.1 time: 0.166029 Jul 28 10:38:31.088785 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 132/276] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:30 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28415 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:31.266506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:31.268710 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:31.276409 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:31.276841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:31.277703 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:31.278055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:31.393322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2a118381-db2e-4760-ac88-6087419d6bfc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 26279 microversion: 2.20 time: 0.130967 Jul 28 10:38:31.393962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 145/277] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:31 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 26279 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:31.831452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1528876505", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "62d4883f-dea5-4f88-8684-dde642b6cfa0"}]}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:31.916717 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-05e5cab1-9f03-479d-9b92-3dedd0b0006f req-5dd771da-bacd-45e1-9d05-407f02fa399b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713a603f-c5ec-4fef-bb27-071aa8601e5c", "name": "network-vif-plugged", "status": "completed", "tag": "65a0589d-0df9-4460-8592-67b5a197a706"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:31.917237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] validate_networks() for [('62d4883f-dea5-4f88-8684-dde642b6cfa0', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:38:31.921994 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:31.921994 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:31.959744 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-05e5cab1-9f03-479d-9b92-3dedd0b0006f req-5dd771da-bacd-45e1-9d05-407f02fa399b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:31.960688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-05e5cab1-9f03-479d-9b92-3dedd0b0006f req-5dd771da-bacd-45e1-9d05-407f02fa399b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:31.992975 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-05e5cab1-9f03-479d-9b92-3dedd0b0006f req-5dd771da-bacd-45e1-9d05-407f02fa399b service nova] Creating event network-vif-plugged:65a0589d-0df9-4460-8592-67b5a197a706 for instance 713a603f-c5ec-4fef-bb27-071aa8601e5c on hv-cinder-80043 Jul 28 10:38:31.999776 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-05e5cab1-9f03-479d-9b92-3dedd0b0006f req-5dd771da-bacd-45e1-9d05-407f02fa399b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091928 Jul 28 10:38:32.001138 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 146/278] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:38:32.009875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:32.012017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:32.023106 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.023763 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.024990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.037811 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.377804 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:32.404530 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3af13f05-8b74-4676-b3f1-31f077a94372 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.401941 Jul 28 10:38:32.425676 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 147/279] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:32 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:32.431106 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:32.433435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:32.456698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.457178 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.457961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.458393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.604861 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:32.605289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:32.605942 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:32.606514 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:32.607108 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:32.620172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:32.627023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.627472 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.628153 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-56ed5a18-05f1-4f8e-9e71-9b9a6d066d2f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.201366 Jul 28 10:38:32.628293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.628678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.628865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 148/280] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:32 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:32.634467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:32.635448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:32.642303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.642844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.643896 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.644329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.648568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:32.652811 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for user 39dc329d6654473e869f8892dbb3e046 and project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:32.667708 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:38:32.670318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:38:32.718998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-56e15485-2a66-49f8-b6cd-9478e807dd88 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891436 Jul 28 10:38:32.719843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 133/281] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:38:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:38:32.729611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:32.730607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:32.736906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.737297 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:32.738083 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:32.738698 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:33.023357 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-22143e9d-c55b-4259-a351-b494e1c6b635 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 27322 microversion: 2.20 time: 0.297181 Jul 28 10:38:33.024944 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 134/282] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:32 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 27322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:33.030328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-91fa6337-790c-4988-8239-7a702543cdaa tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:33.031163 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-91fa6337-790c-4988-8239-7a702543cdaa tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:33.075592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-83f66ead-37e3-447c-9fec-9dd962301dea tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28583 microversion: 2.1 time: 0.445569 Jul 28 10:38:33.080375 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 149/283] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:32 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28583 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:33.085071 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-91fa6337-790c-4988-8239-7a702543cdaa tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:33.092346 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-91fa6337-790c-4988-8239-7a702543cdaa tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1218 microversion: 2.1 time: 0.066028 Jul 28 10:38:33.093051 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 135/284] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:33 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:33.441998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:33.442797 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:33.450552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:33.450991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:33.451763 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:33.452189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:33.578395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:33.586418 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1e39764e-1d3f-48d1-8780-519eaea1bd63 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.149063 Jul 28 10:38:33.586914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 150/285] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:33 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:33.646606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:33.647805 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:33.654524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:33.654972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:33.655735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:33.656355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:33.788660 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:33.796291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c688d9af-3789-40af-803b-bd3880b1b4da tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1313 microversion: 2.1 time: 0.153854 Jul 28 10:38:33.796871 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 136/286] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:33 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:34.035651 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:34.036574 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:34.043059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.043506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.044297 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.044705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.088551 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:34.089610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:34.096099 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.096547 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.097371 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.097807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.311059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-932c8b44-b1c8-47ab-a513-ba76a0b984b2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 27669 microversion: 2.20 time: 0.278870 Jul 28 10:38:34.311704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 151/287] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:34 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 27669 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:34.316690 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:34.317413 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:34.324542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.325024 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.325832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.326279 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.382559 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ef9a6820-a68b-4463-ad57-706fa7fc12d8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28583 microversion: 2.1 time: 0.298388 Jul 28 10:38:34.384054 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 137/288] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:34 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28583 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:34.391749 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:34.399861 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c79b7301-2c9a-4412-9a9d-24738bbd22e3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1276 microversion: 2.1 time: 0.086982 Jul 28 10:38:34.400453 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 152/289] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:34 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:34.604223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:34.604954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:34.611881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.612360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.613238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.613685 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.817896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:34.822312 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:34.822934 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:34.836073 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ad18cbdf-ef61-4b8f-ae9b-59f088fd2cf9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.236548 Jul 28 10:38:34.837534 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.838545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 138/290] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:34 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:34.839218 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:34.840265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:34.841005 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.008022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:35.015925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-559add0d-2ef6-45b1-95cd-55f38f427990 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1497 microversion: 2.1 time: 0.206225 Jul 28 10:38:35.016500 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 153/291] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:34 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:35.325233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:35.327762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:35.338565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.339347 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.340430 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.341653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.395967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:35.397070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:35.403966 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.404412 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.405217 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.405647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.539862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7e765f49-b8c6-4cbb-8bff-546cf008e0b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 27938 microversion: 2.20 time: 0.219871 Jul 28 10:38:35.540540 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 139/292] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:35 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 27938 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:35.545478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:35.546161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:35.553293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.553748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.554523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.554961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.606806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6014c29e-96d7-4552-9adb-06f945f6152b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28583 microversion: 2.1 time: 0.214180 Jul 28 10:38:35.607455 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 154/293] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:35 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28583 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:35.613288 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-c2d49e40-27b7-487f-9630-9a60345b4801 req-b3ca3159-70a6-4ad6-8f39-85b36c201d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac711f2-4c32-4273-baa3-89d7f6fa16b9", "tag": "cd19cc6a-e63e-4e60-8c1c-07e4a5d3f83e"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:35.618626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:35.618626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:35.626542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c2d49e40-27b7-487f-9630-9a60345b4801 req-b3ca3159-70a6-4ad6-8f39-85b36c201d17 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.626986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c2d49e40-27b7-487f-9630-9a60345b4801 req-b3ca3159-70a6-4ad6-8f39-85b36c201d17 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.639238 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-c2d49e40-27b7-487f-9630-9a60345b4801 req-b3ca3159-70a6-4ad6-8f39-85b36c201d17 service nova] Creating event network-changed:cd19cc6a-e63e-4e60-8c1c-07e4a5d3f83e for instance fac711f2-4c32-4273-baa3-89d7f6fa16b9 on hv-cinder-80043 Jul 28 10:38:35.648214 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-c2d49e40-27b7-487f-9630-9a60345b4801 req-b3ca3159-70a6-4ad6-8f39-85b36c201d17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038073 Jul 28 10:38:35.649303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 155/294] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:35.718719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:35.719297 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:35.725876 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.726321 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.727356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.728063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.768400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:38:35.793461 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:35.803744 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bb4b956b-d2f2-4745-95ac-988babd76171 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.261465 Jul 28 10:38:35.806008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 140/295] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:35 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:35.854464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:35.855228 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:35.861957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.862619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.863761 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.864201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.869275 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ea97dc74-6d21-46c5-b80e-c35c146e78df tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "DELETE /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 204 len: 0 microversion: 2.1 time: 0.154210 Jul 28 10:38:35.869842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 156/296] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:38:35 2021] DELETE /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:38:35.878790 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:35.879493 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:35.885991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.893377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:35.894542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:35.895347 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.049411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:36.058791 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b6f0e1f4-cde5-4395-a43c-9409553371ff tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1503 microversion: 2.1 time: 0.184087 Jul 28 10:38:36.059567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 157/297] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:35 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:36.108608 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:36.116317 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e4aa6356-403b-473c-9d03-5ed1a797b2d1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.265419 Jul 28 10:38:36.116920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 141/298] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:35 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:36.551129 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:36.552080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:36.558560 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:36.559006 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.559787 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:36.560220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.619263 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:36.620251 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:36.627203 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:36.627657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.628440 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:36.628908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.745548 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ed58a622-6acc-40f7-8bb7-e44a39fff122 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28150 microversion: 2.20 time: 0.198094 Jul 28 10:38:36.746198 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 158/299] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:36 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28150 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:36.795438 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-90ad699f-067d-4bc3-9c91-5555e9c65122 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28583 microversion: 2.1 time: 0.180356 Jul 28 10:38:36.796071 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 142/300] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:36 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28583 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:36.824551 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:36.825415 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:36.831871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:36.832396 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.834627 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:36.835083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:36.977544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:36.984794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e72bdb53-bdf7-468a-900a-066c485e99bb tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.164166 Jul 28 10:38:36.986122 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 159/301] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:36 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:37.082636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:37.083342 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:37.090889 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.091733 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.092504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.092960 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.135715 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:37.136598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:37.154701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.157401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.158689 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.159216 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.227105 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:37.237331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cbac9e6f-26d7-4246-8baf-a7f64c9af6d9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1503 microversion: 2.1 time: 0.164850 Jul 28 10:38:37.237925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 143/302] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:37 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:37.299054 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:37.307187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-909be08b-9efa-47a9-9886-328912b37269 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.176924 Jul 28 10:38:37.307750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 160/303] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:37 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:37.757327 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:37.758241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:37.765606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.766406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.767780 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.768582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.807072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:37.808035 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:37.813788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.814227 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.815163 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:37.816213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:37.940379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-76a95815-d7d5-4d71-9b8d-1670dac53302 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28191 microversion: 2.20 time: 0.186637 Jul 28 10:38:37.941066 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 144/304] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:37 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28191 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:38.001073 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f82ca1ba-b71a-47c9-be5d-617d49dc1b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28583 microversion: 2.1 time: 0.197603 Jul 28 10:38:38.001714 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 161/305] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:37 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28583 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:38.003266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:38.003972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:38.011124 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.011580 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.012358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.012820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.164714 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:38.174349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0505e1b4-0528-42ba-9a84-5867cb049a58 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.174857 Jul 28 10:38:38.174932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 145/306] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:37 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:38.254792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:38.256240 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:38.263166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.263608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.264374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.264824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.324163 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:38.324787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:38.330879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.331333 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.332112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.332545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.400449 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:38.407837 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-09d952db-e771-492d-8a1c-23a600522ccf tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1503 microversion: 2.1 time: 0.157138 Jul 28 10:38:38.408639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 162/307] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:38 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:38.477847 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:38.485167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2ef6c73c-c4cb-41b5-9547-b1a07e256835 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.164582 Jul 28 10:38:38.485713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 146/308] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:38 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:38.952263 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:38.953213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:38.964061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.964645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:38.965688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:38.967171 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.014814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:39.015787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:39.025355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.025814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.026591 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.029162 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.116947 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3727c5e3-c56b-4da4-820c-8d2a44388148 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28191 microversion: 2.20 time: 0.168486 Jul 28 10:38:39.117780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 163/309] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:38 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28191 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:39.174080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a830724b-523c-4a87-8307-4ca923b57d86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28583 microversion: 2.1 time: 0.163009 Jul 28 10:38:39.175241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 147/310] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:39 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28583 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:39.192440 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:39.194917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:39.202293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.202821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.203901 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.204413 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.341368 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:39.348545 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9619e586-76fe-49b1-bd9d-8e53151d0aa3 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.160599 Jul 28 10:38:39.349127 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 164/311] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:39 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:39.425533 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:39.426242 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:39.433965 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.434922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.435878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.436317 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.504052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:39.504888 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:39.511692 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.512666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.514017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.514707 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.542740 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:39.551559 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d6ce38fe-0559-4cd7-8b5e-eddee71cf582 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1461 microversion: 2.1 time: 0.130369 Jul 28 10:38:39.553174 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 148/312] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:39 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1461 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:39.594268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-bbe2b5b1-445d-403a-96bc-ab3430c237bd req-976b59ae-7397-4cde-b88b-0a77298d9816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "713a603f-c5ec-4fef-bb27-071aa8601e5c", "name": "network-vif-deleted", "tag": "65a0589d-0df9-4460-8592-67b5a197a706"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:39.595767 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:39.595767 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:38:39.612949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-bbe2b5b1-445d-403a-96bc-ab3430c237bd req-976b59ae-7397-4cde-b88b-0a77298d9816 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:39.613609 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-bbe2b5b1-445d-403a-96bc-ab3430c237bd req-976b59ae-7397-4cde-b88b-0a77298d9816 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:39.636257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-bbe2b5b1-445d-403a-96bc-ab3430c237bd req-976b59ae-7397-4cde-b88b-0a77298d9816 service nova] Creating event network-vif-deleted:65a0589d-0df9-4460-8592-67b5a197a706 for instance 713a603f-c5ec-4fef-bb27-071aa8601e5c on hv-cinder-80043 Jul 28 10:38:39.645040 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-bbe2b5b1-445d-403a-96bc-ab3430c237bd req-976b59ae-7397-4cde-b88b-0a77298d9816 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053496 Jul 28 10:38:39.646399 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 149/313] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:38:39.736643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:39.744269 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-db82365b-96ba-4e83-92be-f5321b04cbcd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1522 microversion: 2.1 time: 0.244360 Jul 28 10:38:39.745599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 165/314] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:39 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:40.133176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:40.133176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:40.137328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.137786 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.138563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.138990 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.187144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:40.188110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:40.194513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.195065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.195957 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.196444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.284604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5652bf17-ae9e-44bd-b709-40dc2982c9a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28191 microversion: 2.20 time: 0.158783 Jul 28 10:38:40.289652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 150/315] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:40 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28191 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:40.364765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4a997b48-550d-4109-9283-8cc091534279 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 28753 microversion: 2.1 time: 0.180483 Jul 28 10:38:40.366369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:40.367102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 166/316] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:40 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 28753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:40.369174 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:40.377914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.378558 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.381583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.382283 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.539739 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:40.559748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fe6ea418-cdae-43b2-acec-d538b66c827f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.197664 Jul 28 10:38:40.564038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 151/317] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:40 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:40.574646 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:40.575436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:40.585667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.586563 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.587352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.587783 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.625779 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.626381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.626840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lazy-loading 'fault' on Instance uuid 713a603f-c5ec-4fef-bb27-071aa8601e5c {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:38:40.684138 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:40.691225 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e2161ee3-706c-4333-9af0-1c646c1e3a89 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 200 len: 1303 microversion: 2.1 time: 0.124774 Jul 28 10:38:40.691898 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 167/318] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:40 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:40.763334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:40.763959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:40.770639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.771082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.772432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.772967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.949290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:40.956631 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d11fb46a-079b-44b2-a252-280e51c206bc tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1502 microversion: 2.1 time: 0.196997 Jul 28 10:38:40.957229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 152/319] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:40 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:40.974166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:40.975569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:40.981721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.982169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:40.982942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:40.983537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.128676 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:41.136131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d5cad7e5-27f7-4f9d-8095-f449f28e787e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1516 microversion: 2.1 time: 0.166280 Jul 28 10:38:41.136699 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 168/320] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:40 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:41.298265 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:41.299411 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:41.307051 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.307633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.309168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.309836 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.378084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:41.379628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:41.401558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.402262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.403695 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.404304 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.448331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-547ea349-d850-4f19-b612-8bd55540438c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28480 microversion: 2.20 time: 0.154306 Jul 28 10:38:41.449580 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 153/321] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:41 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28480 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:41.544517 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-74540c43-c7ca-4805-a852-1eb6d169a60b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 29770 microversion: 2.1 time: 0.170110 Jul 28 10:38:41.548426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 169/322] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:41 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 29770 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:41.581511 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:41.582638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:41.590013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.590573 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.591457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.592037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.717579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:41.718299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 713a603f-c5ec-4fef-bb27-071aa8601e5c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:41.729296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.729296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.729296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:41.729600 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:41.729704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:41.748824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] HTTP exception thrown: Instance 713a603f-c5ec-4fef-bb27-071aa8601e5c could not be found. Jul 28 10:38:41.749429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Returning 404 to user: Instance 713a603f-c5ec-4fef-bb27-071aa8601e5c could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:41.750259 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-40c9e04a-fc82-42b8-b267-f984c37fb7e8 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c" status: 404 len: 111 microversion: 2.1 time: 0.045019 Jul 28 10:38:41.750950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 170/323] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:41 2021] GET /compute/v2.1/servers/713a603f-c5ec-4fef-bb27-071aa8601e5c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:38:41.751563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-aaf57020-77ec-4145-98b4-e0e6a94637fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.174405 Jul 28 10:38:41.752130 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 154/324] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:41 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:41.853151 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1860949648", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "2871a1c5-4cd2-4ce6-8e19-558dcce5feb3"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:42.064119 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] validate_networks() for [('2871a1c5-4cd2-4ce6-8e19-558dcce5feb3', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:38:42.417230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:42.417816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:42.418274 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:42.418770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:42.419254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:42.427844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.428287 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.429119 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.429550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.445649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Getting quotas for project 302ffd5aee604675b6633eb88efb3dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:42.449594 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Getting quotas for user 287bf80d7a0d49e4a049c76ba95ebafd and project 302ffd5aee604675b6633eb88efb3dfb. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:42.461760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:38:42.462213 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:42.463360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:42.464109 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:38:42.470588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.471060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.472139 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.472606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.536678 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ccacda8d-e384-4df7-afde-34fefc46d719 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687174 Jul 28 10:38:42.538298 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 171/325] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:38:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:38:42.548609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3e0d9a88-df69-4b83-92d2-3553b593e37e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:42.549239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3e0d9a88-df69-4b83-92d2-3553b593e37e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:42.588512 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-44a65fa2-9a54-4fa4-9075-a105624311e7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28480 microversion: 2.20 time: 0.131071 Jul 28 10:38:42.590061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 155/326] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:42 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28480 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:42.594936 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:42.595937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:42.602336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.602809 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.603560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.604186 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.612522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3e0d9a88-df69-4b83-92d2-3553b593e37e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:42.619543 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3e0d9a88-df69-4b83-92d2-3553b593e37e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1214 microversion: 2.1 time: 0.074949 Jul 28 10:38:42.620280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 172/327] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:42 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:42.627702 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:42.628893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:42.637691 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.638137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.638946 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.639528 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.644726 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lazy-loading 'flavor' on Instance uuid a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:38:42.777807 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-29ea1ed8-d1f3-41d6-883a-f4fd8d2de0f2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 30871 microversion: 2.1 time: 0.155960 Jul 28 10:38:42.782832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 173/328] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:42 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 30871 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:42.788697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:42.789526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ab0a05b1-f683-4943-aefe-af95d5432da6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action" status: 200 len: 32 microversion: 2.1 time: 0.198513 Jul 28 10:38:42.789744 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:42.790478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 156/329] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:42 2021] POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:38:42.799174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.799832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.801358 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.802127 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.810454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:42.811724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:42.820471 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.820993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.821779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:42.822259 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:42.971569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:42.980978 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a5cb4547-b1d1-4276-a814-5384aa5ba4ae tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.200335 Jul 28 10:38:42.981752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 174/330] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:42 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:43.074237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:43.082281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8955f3dc-5412-4829-80dc-a06dc50f2cea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.277366 Jul 28 10:38:43.083095 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 157/331] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:42 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:43.596311 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-d30d6e66-1cac-4b60-87b6-bb1912339393 req-62e281e1-2231-47d5-9c12-a367e428b896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac711f2-4c32-4273-baa3-89d7f6fa16b9", "name": "network-vif-plugged", "status": "completed", "tag": "cd19cc6a-e63e-4e60-8c1c-07e4a5d3f83e"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:43.598324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:43.598324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:38:43.600895 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:43.603328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:43.606399 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-d30d6e66-1cac-4b60-87b6-bb1912339393 req-62e281e1-2231-47d5-9c12-a367e428b896 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.607141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-d30d6e66-1cac-4b60-87b6-bb1912339393 req-62e281e1-2231-47d5-9c12-a367e428b896 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.611276 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.611732 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.612513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.612988 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.624210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-d30d6e66-1cac-4b60-87b6-bb1912339393 req-62e281e1-2231-47d5-9c12-a367e428b896 service nova] Creating event network-vif-plugged:cd19cc6a-e63e-4e60-8c1c-07e4a5d3f83e for instance fac711f2-4c32-4273-baa3-89d7f6fa16b9 on hv-cinder-80043 Jul 28 10:38:43.630088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-d30d6e66-1cac-4b60-87b6-bb1912339393 req-62e281e1-2231-47d5-9c12-a367e428b896 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Jul 28 10:38:43.630801 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 175/332] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:43.640847 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:43.643416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:43.649693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.650344 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.651119 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.651546 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.718174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:43.726144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-62584643-5bdf-4985-8191-beacd8208b1f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1266 microversion: 2.1 time: 0.091381 Jul 28 10:38:43.726700 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 176/333] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:43 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:43.790634 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:43.791347 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:43.797842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.798286 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.799065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:43.799543 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:43.877646 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0a8d6fad-3b35-486e-b383-f302669bd868 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28648 microversion: 2.20 time: 0.281849 Jul 28 10:38:43.881773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 158/334] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:43 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28648 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:43.998277 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:43.999112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:44.005972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.006425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.007199 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.007839 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.052984 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-039e788d-66b3-454f-83d7-5c3bf0bd848e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 32018 microversion: 2.1 time: 0.266448 Jul 28 10:38:44.053694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 177/335] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:43 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 32018 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:44.102121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:44.104309 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:44.113110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.113917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.116336 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.117242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.288150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:44.295856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f4c0c289-678c-4474-91c3-09d39d170de1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.199518 Jul 28 10:38:44.296779 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 178/336] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:44 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:44.416468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:44.424529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d5fd148e-d94b-4221-9d77-f9ef263c2132 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.430593 Jul 28 10:38:44.425119 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 159/337] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:43 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:44.743300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:44.743810 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:44.750146 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.750595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.752189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.752189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.812416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:44.820811 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7e9aa7c4-54a4-4e7f-ae23-9195003be149 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1272 microversion: 2.1 time: 0.081386 Jul 28 10:38:44.821384 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 179/338] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:44 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:44.890145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:44.891058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:44.897796 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.898265 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:44.899047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:44.899484 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.018090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-44b1fdd9-6c40-4268-81a5-ecc56f5fecbf tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28648 microversion: 2.20 time: 0.131455 Jul 28 10:38:45.018844 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 160/339] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:44 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28648 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:45.064572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:45.065637 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:45.072728 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.073311 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.074162 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.074601 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.198964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9a14a0f0-14da-4ef0-9c89-f37d61811f72 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 32762 microversion: 2.1 time: 0.137919 Jul 28 10:38:45.199860 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 180/340] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:45 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 32762 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:45.314082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:45.314779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:45.322031 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.322560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.323478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.323954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.441650 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:45.442352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:45.449499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.449956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.450733 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.451168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.517766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:45.525715 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-219290bd-7f28-46e5-a8d1-9cab6e3e6022 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.215662 Jul 28 10:38:45.526428 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 161/341] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:45 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:45.605820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:45.613160 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-af28eb37-467e-41be-9a77-5677e524fe6d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1318 microversion: 2.1 time: 0.175522 Jul 28 10:38:45.613721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 181/342] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:45 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:45.837249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:45.837859 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:45.843938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.844381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:45.845204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:45.845636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.020897 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:46.029824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-501bee63-1c55-40df-98b4-5eea5e0017f7 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.196486 Jul 28 10:38:46.031729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:46.033293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:46.040212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 162/343] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:45 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:46.040711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.041343 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.042218 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.042723 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.121325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-d0e0c1ef-1ace-4996-a7f4-c57d3f17b69e req-b28c5840-964f-4848-9e38-6d47e13f0778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f96299-0e89-4e9c-91e0-918a6776374b", "tag": "22dde497-86e4-4d95-9b10-53c6d60e55dc"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:46.124255 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:46.124255 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:38:46.144712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-d0e0c1ef-1ace-4996-a7f4-c57d3f17b69e req-b28c5840-964f-4848-9e38-6d47e13f0778 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.145188 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-d0e0c1ef-1ace-4996-a7f4-c57d3f17b69e req-b28c5840-964f-4848-9e38-6d47e13f0778 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.165921 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-d0e0c1ef-1ace-4996-a7f4-c57d3f17b69e req-b28c5840-964f-4848-9e38-6d47e13f0778 service nova] Creating event network-changed:22dde497-86e4-4d95-9b10-53c6d60e55dc for instance 29f96299-0e89-4e9c-91e0-918a6776374b on hv-cinder-80043 Jul 28 10:38:46.172398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-d0e0c1ef-1ace-4996-a7f4-c57d3f17b69e req-b28c5840-964f-4848-9e38-6d47e13f0778 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054795 Jul 28 10:38:46.173908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 163/344] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:46.210854 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:46.212003 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:46.218398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.218852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.219701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.220148 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.239412 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-64a35358-ab98-44ef-bda6-ec25571ef355 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28648 microversion: 2.20 time: 0.212149 Jul 28 10:38:46.240679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 182/345] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:46 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28648 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:46.343152 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-20ad409e-94e3-41b2-8539-6d183abf81ca tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 33157 microversion: 2.1 time: 0.136121 Jul 28 10:38:46.344706 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 164/346] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:46 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 33157 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:46.544528 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:46.545176 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:46.551650 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.552101 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.553503 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.553946 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.631790 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:46.632492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:46.647609 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.648418 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.649762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:46.650588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:46.750549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:46.759381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a3206223-e7db-4434-8068-775205ce2c15 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.219223 Jul 28 10:38:46.759956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 183/347] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:46 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:46.869015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:46.877436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-de9b9873-3cef-4b61-9ea7-dedc2033ff29 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1507 microversion: 2.1 time: 0.249712 Jul 28 10:38:46.878017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 165/348] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:46 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:47.048064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:47.048595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:47.055997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.056557 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.057450 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.057962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.231303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:47.239742 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e1370cbc-b6f8-48fb-803f-684dbb3f77c4 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.195972 Jul 28 10:38:47.240803 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 184/349] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:47 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:47.252392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:47.253378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:47.263301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.264047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.265369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.265868 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.357157 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:47.358191 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:47.364359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.365108 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.365858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.366372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.386892 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-faf556a6-9c37-41e6-bbe8-1fde47f83499 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28648 microversion: 2.20 time: 0.138768 Jul 28 10:38:47.387543 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 166/350] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:47 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28648 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:47.521201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7082901a-d8de-46d7-97d1-60872206d555 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 33543 microversion: 2.1 time: 0.168032 Jul 28 10:38:47.522377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 185/351] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:47 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 33543 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:47.777606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:47.778303 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:47.784670 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.785151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.785916 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:47.786356 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:47.912821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:47.920096 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-600d02ca-9962-4242-904b-502a73f40d01 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.146506 Jul 28 10:38:47.920649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 167/352] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:47 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:48.249698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98b1ff18-5120-49b4-baa7-d9d23fdec023"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:48.251006 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:48.257669 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:48.258284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.258397 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:48.258734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.259507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.259943 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.264217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.264671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.265478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.265914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.391763 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:48.401457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d5a01ec4-2e77-4b75-bed1-bbeab68e3e35 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.147050 Jul 28 10:38:48.402052 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 168/353] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:48 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:48.407161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:48.408217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:48.415151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.415597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.416359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.416826 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.528067 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8220e958-752c-4500-a5c8-32c65f80b5b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28648 microversion: 2.20 time: 0.123137 Jul 28 10:38:48.528067 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 169/354] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:48 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28648 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:48.532889 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:48.533888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:48.541290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.541744 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.542523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.542979 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.544964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8050cb80-f5f2-477d-9245-384d1941559a tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299564 Jul 28 10:38:48.545948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 186/355] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:38:48 2021] POST /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:38:48.715087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9c3fd289-e37e-473c-a79c-272770d2a9d3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 34031 microversion: 2.1 time: 0.185741 Jul 28 10:38:48.715699 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 170/356] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:48 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 34031 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:48.937241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:48.937922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:48.945428 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.945865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:48.946617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:48.947044 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.065319 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:49.073836 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fa8ea91d-512e-40c1-b092-b2974a4b3e0d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.140594 Jul 28 10:38:49.074464 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 187/357] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:48 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:49.419257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:49.420063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:49.426584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:49.427036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.428473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:49.428941 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.542714 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:49.544702 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:49.551939 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:49.553608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.554681 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:49.555334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.563978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:49.572909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bcdf2f30-95b5-42be-9b0e-f1b70beb09fc tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.157645 Jul 28 10:38:49.573317 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 171/358] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:49 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:49.669473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b99736e7-0b97-4c28-b00c-f49636d82e8a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 28648 microversion: 2.20 time: 0.134629 Jul 28 10:38:49.673209 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 188/359] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:49 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 28648 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:49.726816 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:49.727815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:49.733545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:49.734000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.734765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:49.735237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:49.858830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1e391559-49ae-440d-a3c4-f7256801f755 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 34755 microversion: 2.1 time: 0.136401 Jul 28 10:38:49.859715 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 172/360] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:49 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 34755 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:50.091662 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:50.092475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:50.098955 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.099592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.100434 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.101013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.224446 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:50.233861 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-301a5c8a-905a-4e7a-b38c-eb28a5c9f152 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.146085 Jul 28 10:38:50.234436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 189/361] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:50 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:50.590053 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:50.590752 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:50.597306 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.597754 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.598516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.598996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.681514 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:50.682536 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:50.693923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.694468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.695469 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.695907 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.736461 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:50.744427 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2775c3ff-ae18-4234-ba78-abab771ef3dd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.158376 Jul 28 10:38:50.745018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 173/362] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:50 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:50.823361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f3e39aa6-200b-460d-943e-053cdc6a0282 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 29220 microversion: 2.20 time: 0.146257 Jul 28 10:38:50.824011 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 190/363] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:50 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 29220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:50.871456 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:50.872288 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:50.878377 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.878823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:50.879585 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:50.880018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.014214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5b6b6352-8e95-44c1-a9b0-db23d4195673 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 35294 microversion: 2.1 time: 0.146342 Jul 28 10:38:51.014832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 174/364] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:50 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 35294 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:51.250559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:51.251251 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:51.257710 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:51.258154 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.258924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:51.259357 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.376597 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:51.383947 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e72ab11b-24cf-477e-8ffc-cf3720a45b65 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.137563 Jul 28 10:38:51.384501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 191/365] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:51 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:51.762604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:51.763297 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:51.770290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:51.770738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.772280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:51.772715 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.835894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:51.836806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:51.842504 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:51.842944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.843705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:51.844132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:51.894425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:51.905519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fce7dee8-b9c5-4344-ba3c-91cdd5203bfe tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.147002 Jul 28 10:38:51.906069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 175/366] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:51 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:51.957176 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-54da7bc6-1bd0-40b0-9124-e47335dc0da4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 30396 microversion: 2.20 time: 0.125392 Jul 28 10:38:51.957995 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 192/367] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:51 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 30396 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:52.025375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:52.026227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:52.031956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.032399 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.033198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.033629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.170388 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3a9b0b3d-04dd-4f33-95f8-82c79ae298fa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 35955 microversion: 2.1 time: 0.148999 Jul 28 10:38:52.170996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 176/368] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:52 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 35955 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:52.401424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:52.402125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:52.408612 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.409094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.409858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.410293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.528036 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:52.535264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ede50180-f09a-4bc3-82d9-d29d8857d670 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.138017 Jul 28 10:38:52.535827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 193/369] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:52 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:52.921837 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:52.922533 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:52.929507 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.929957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.930723 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.931162 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.969271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:52.970197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:52.976955 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.977406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:52.978175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:52.978609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:53.055043 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:53.062176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-be3455a3-0aad-4e5b-b29f-35fe3ed71be9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.144411 Jul 28 10:38:53.062734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 177/370] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:52 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:53.114825 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c03919cb-635c-4d81-8ebd-28096c19f5a1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 31486 microversion: 2.20 time: 0.148870 Jul 28 10:38:53.115590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 194/371] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:52 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 31486 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:53.182093 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:53.183000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:53.188914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:53.189363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:53.190129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:53.190565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:53.306832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-53768b42-6f79-4848-b8ba-f81e34ec58e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 36856 microversion: 2.1 time: 0.128173 Jul 28 10:38:53.307381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 178/372] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:53 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 36856 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:53.554173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:53.554870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:53.561447 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:53.561895 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:53.562653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:53.563088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:53.643751 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-49f2c796-8518-4ab1-b9db-aea299dd7519 req-8a36b90c-939b-49b6-876b-ad61a2532c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f96299-0e89-4e9c-91e0-918a6776374b", "name": "network-vif-plugged", "status": "completed", "tag": "22dde497-86e4-4d95-9b10-53c6d60e55dc"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:53.645537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:38:53.645537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:38:53.654465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-49f2c796-8518-4ab1-b9db-aea299dd7519 req-8a36b90c-939b-49b6-876b-ad61a2532c12 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:53.655074 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-49f2c796-8518-4ab1-b9db-aea299dd7519 req-8a36b90c-939b-49b6-876b-ad61a2532c12 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:53.667451 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-49f2c796-8518-4ab1-b9db-aea299dd7519 req-8a36b90c-939b-49b6-876b-ad61a2532c12 service nova] Creating event network-vif-plugged:22dde497-86e4-4d95-9b10-53c6d60e55dc for instance 29f96299-0e89-4e9c-91e0-918a6776374b on hv-cinder-80043 Jul 28 10:38:53.672175 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-49f2c796-8518-4ab1-b9db-aea299dd7519 req-8a36b90c-939b-49b6-876b-ad61a2532c12 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032572 Jul 28 10:38:53.673014 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 179/373] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:38:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:38:53.696283 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:53.703746 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8352a945-54cf-4290-b7d8-6efa25bc9424 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.154222 Jul 28 10:38:53.704306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 195/374] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:53 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:54.079617 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:54.080314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:54.086773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.087216 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.087973 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.088432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.126757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:54.127585 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:54.133532 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.133980 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.134752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.135183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.212450 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:54.219823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7bd9f4aa-ad94-4584-8ef5-e761aa03492e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.144190 Jul 28 10:38:54.220372 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 180/375] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:54 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:54.318678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:54.319594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:54.325364 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.325830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.326592 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.327029 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.493612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-153e3021-f3f8-4a08-8017-eb27a8e4ae74 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 37712 microversion: 2.1 time: 0.178626 Jul 28 10:38:54.494419 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 181/376] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:54 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 37712 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:38:54.556697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4f65ba67-829c-4730-a499-5196369b9fa4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 32400 microversion: 2.20 time: 0.433772 Jul 28 10:38:54.557364 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 196/377] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:54 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 32400 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:54.721114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:54.721813 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:54.728824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.729273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.730036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:54.730472 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:54.854376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:54.861681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4f985ea5-bd6b-45a9-81ea-973e3d5e5cc7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.144637 Jul 28 10:38:54.862242 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 182/378] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:54 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:55.237600 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:55.238211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:55.244642 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.245137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.245900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.246335 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.366218 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:55.375599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c0095a11-7bfc-4d5f-a13b-e2a0d3fa8422 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.142079 Jul 28 10:38:55.376167 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 197/379] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:55 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:55.506620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:55.507428 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:55.513240 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.513685 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.514443 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.514878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.567433 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:55.569266 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:55.574997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.575436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.576187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.576615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.689641 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-db8849e7-b080-48ec-8a34-b2d92166dd03 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 38083 microversion: 2.1 time: 0.187362 Jul 28 10:38:55.690341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 183/380] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:55 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 38083 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:55.748145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3f903b02-8532-4126-9967-2ae093c18685 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 32743 microversion: 2.20 time: 0.183892 Jul 28 10:38:55.748800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 198/381] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:55 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 32743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:55.879487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:55.880264 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:55.887426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.887881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:55.888699 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:55.889167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.016763 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:56.025022 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bb387631-9eda-41d4-b081-59770e86409c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.149617 Jul 28 10:38:56.025581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 184/382] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:55 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:56.393385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:56.394091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:56.400679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:56.401159 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.401920 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:56.402354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.522787 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:56.530145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0e39fbcb-2079-41a1-bae7-692ab6b3b29f tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1314 microversion: 2.1 time: 0.140813 Jul 28 10:38:56.530708 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 199/383] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:56 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:56.701845 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:56.702673 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:56.708817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:56.709274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.710063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:56.710499 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.760046 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:56.761095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:56.767067 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:56.767511 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.768266 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:56.768694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:56.818646 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-22a329b0-89e8-44d2-877d-ff8898827104 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 38083 microversion: 2.1 time: 0.119623 Jul 28 10:38:56.819295 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 185/384] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:56 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 38083 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:56.890478 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bf120fbb-79fd-4525-a631-dcdd7ba7af53 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 33584 microversion: 2.20 time: 0.134025 Jul 28 10:38:56.891110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 200/385] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:56 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 33584 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:56.964677 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1312288990", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2018612799", "security_groups": [{"name": "tempest-secgroup-smoke-2054633035"}], "networks": [{"uuid": "d94eb1ae-fa55-4a6b-b36d-877fb700e06d"}], "block_device_mapping_v2": [{"uuid": "05818491-df45-4efe-b0e3-b7fa54a7015d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:57.042640 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:57.043416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.050042 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.050505 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.051325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.051767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.070190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] validate_networks() for [('d94eb1ae-fa55-4a6b-b36d-877fb700e06d', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:38:57.186554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:57.194302 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d215c78e-779e-4c47-be43-aa6bb663c1b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.155519 Jul 28 10:38:57.194881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 201/386] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:57 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:57.199289 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98b1ff18-5120-49b4-baa7-d9d23fdec023"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:57.200523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.206373 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.206826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.207595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.208030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.292366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] HTTP exception thrown: Invalid volume: volume 98b1ff18-5120-49b4-baa7-d9d23fdec023 is already attached to instances: fac711f2-4c32-4273-baa3-89d7f6fa16b9 Jul 28 10:38:57.293138 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Returning 400 to user: Invalid volume: volume 98b1ff18-5120-49b4-baa7-d9d23fdec023 is already attached to instances: fac711f2-4c32-4273-baa3-89d7f6fa16b9 {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:38:57.294013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a696f9df-97b1-408d-aa12-94c7431ba169 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098226 Jul 28 10:38:57.294559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 202/387] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:38:57 2021] POST /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:38:57.361982 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:57.362534 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.369259 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.369711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.370495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.370933 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.469735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:38:57.470154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:38:57.470653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:38:57.471059 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:38:57.471500 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:38:57.481397 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.481783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.482571 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.483036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.500150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lazy-loading 'services' on Instance uuid fac711f2-4c32-4273-baa3-89d7f6fa16b9 {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:38:57.500649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Getting quotas for project 02a445a74e104a019c3d28d3f69fa4b3. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:38:57.504468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Getting quotas for user f8f6c76e08d7451c925dfb6654ff0031 and project 02a445a74e104a019c3d28d3f69fa4b3. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:38:57.566381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:38:57.569532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05818491-df45-4efe-b0e3-b7fa54a7015d',volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:38:57.606276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-87e46fe0-74bc-4ce8-a51a-aff9643f80ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9/os-volume_attachments/98b1ff18-5120-49b4-baa7-d9d23fdec023" status: 202 len: 0 microversion: 2.1 time: 0.247937 Jul 28 10:38:57.606930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 203/388] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:38:57 2021] DELETE /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9/os-volume_attachments/98b1ff18-5120-49b4-baa7-d9d23fdec023 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:38:57.611759 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:57.612467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.618830 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.620701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.621579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.622013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.713712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4700a298-45b7-45cb-b01b-8de4729e2e10 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753007 Jul 28 10:38:57.714675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 186/389] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:38:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:38:57.725193 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fc1d48c4-dabc-40cd-9b15-1db1d2485a78 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:57.725993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fc1d48c4-dabc-40cd-9b15-1db1d2485a78 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.754285 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:57.763247 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b8eb2fbf-3f87-475e-b14b-5f2051aa268e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1499 microversion: 2.1 time: 0.155238 Jul 28 10:38:57.764017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 204/390] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:57 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:57.789482 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fc1d48c4-dabc-40cd-9b15-1db1d2485a78 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:57.796915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fc1d48c4-dabc-40cd-9b15-1db1d2485a78 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1089 microversion: 2.1 time: 0.076261 Jul 28 10:38:57.797564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 187/391] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:57 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:57.829965 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:57.830936 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.837946 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.838683 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.839146 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.839608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.908602 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:57.909997 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.917685 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.918132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.918922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.919362 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.967190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-917cc091-8ff7-44b0-90d7-a739ee5b9f9f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 200 len: 38214 microversion: 2.1 time: 0.140775 Jul 28 10:38:57.972598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 205/392] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:38:57 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 38214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:38:57.978797 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:57.980957 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:57.987333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.987788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:57.988918 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:57.989035 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.014146 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5a2b36ac-30f2-4c46-8798-6ad3fe164fd0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/ips" status: 200 len: 146 microversion: 2.1 time: 0.040118 Jul 28 10:38:58.014756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 206/393] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Jul 28 10:38:57 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:38:58.079586 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0ee7320f-c79e-4108-91d0-ff8eda19419f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 34392 microversion: 2.20 time: 0.180647 Jul 28 10:38:58.085156 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 188/394] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:57 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 34392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:58.211349 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:58.211959 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:58.218223 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.218667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.219429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.219868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.346258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:58.354708 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-35973412-858a-4683-8235-38bb187883e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.147594 Jul 28 10:38:58.355400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 207/395] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:58 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:58.389258 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:58.389901 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:58.397215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.397674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.398456 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.398915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.426135 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:38:58.510840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e69f1909-7066-41c4-bbf0-2a99570551c2 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "DELETE /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 204 len: 0 microversion: 2.1 time: 0.125911 Jul 28 10:38:58.511340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 189/396] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:38:58 2021] DELETE /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:38:58.519322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:58.519857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:58.526369 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.526814 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.527575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.528007 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.648976 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:58.656225 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9ed289dc-774d-4950-9852-17c3204f0ba5 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1505 microversion: 2.1 time: 0.140634 Jul 28 10:38:58.656798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 208/397] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:58 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1505 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:58.814166 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:58.814869 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:58.821390 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.821837 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.822613 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:58.823052 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:58.882628 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:58.890033 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2ffabdc8-1f04-4960-a522-cdc9fb68588e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1187 microversion: 2.1 time: 0.079814 Jul 28 10:38:58.890596 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 190/398] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:58 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1187 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:59.091413 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:38:59.092303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:59.098485 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.099593 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.100577 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.100769 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.372015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:59.372815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:59.374495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-56050d52-ca14-4c9f-8673-6dee6f9120cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 34969 microversion: 2.20 time: 0.286609 Jul 28 10:38:59.375445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 209/399] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:38:59 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 34969 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:38:59.378728 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.379175 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.379953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.380387 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.547788 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:59.556074 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fe17e12e-34b6-4f90-b122-230c4217c438 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.187854 Jul 28 10:38:59.557562 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 191/400] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:59 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:38:59.673931 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:59.674711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:59.683466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.684168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.685168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.685998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.821822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:38:59.829657 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ba699ce0-8a59-4935-8a23-6eed71e07f0e tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1505 microversion: 2.1 time: 0.159677 Jul 28 10:38:59.830205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 210/401] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:59 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:38:59.907320 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:38:59.908482 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:38:59.916947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.917340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.918301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:38:59.918737 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:38:59.997076 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:00.012223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f3af1288-8b4c-4941-adc4-4408cc9f815e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1205 microversion: 2.1 time: 0.108508 Jul 28 10:39:00.013260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 192/402] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:38:59 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1205 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:00.132610 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1323256004", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "62d4883f-dea5-4f88-8684-dde642b6cfa0"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:00.195324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] validate_networks() for [('62d4883f-dea5-4f88-8684-dde642b6cfa0', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:39:00.386881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:00.388853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:00.398126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.399822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.400893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.402075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.535332 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ba5e2201-de54-4a62-93d6-05df5c14f3cb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 35692 microversion: 2.20 time: 0.152578 Jul 28 10:39:00.536357 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 193/403] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:00 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 35692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:39:00.575638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:00.576341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:00.583116 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:39:00.584295 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.584710 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:39:00.584891 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.585503 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:39:00.585626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.586037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.586439 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:39:00.587133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:39:00.600245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.601871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.602867 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.603435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.625168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:39:00.629701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Getting quotas for user 39dc329d6654473e869f8892dbb3e046 and project 306fbc7a4d5e433d938a4bae2209a89a. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:39:00.644865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:39:00.648185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:39:00.715287 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e88f0638-0665-4f98-9813-ee350def52a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586391 Jul 28 10:39:00.717417 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 211/404] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:39:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:39:00.729289 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-07661c5d-5d5f-4aef-9370-59af6ce0089b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:00.730559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-07661c5d-5d5f-4aef-9370-59af6ce0089b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:00.811041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-07661c5d-5d5f-4aef-9370-59af6ce0089b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:00.820683 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-07661c5d-5d5f-4aef-9370-59af6ce0089b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1218 microversion: 2.1 time: 0.096596 Jul 28 10:39:00.821699 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:00.832821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 212/405] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:00 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:00.836376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-84c45458-4125-4f3a-a8ea-1d59648add16 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1502 microversion: 2.1 time: 0.265496 Jul 28 10:39:00.837075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 194/406] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:00 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:00.850222 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:00.851084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:00.854573 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42115e59-32a8-4137-a072-28af3efea57c"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:00.855845 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:00.859237 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.860030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.861242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.861798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.863145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.863774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.865838 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.866444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.911297 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] HTTP exception thrown: Cannot 'attach_volume' instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 while it is in vm_state rescued Jul 28 10:39:00.912126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Returning 409 to user: Cannot 'attach_volume' instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 while it is in vm_state rescued {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:39:00.913935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-efd30b58-0fa2-4296-818d-c5e18bb5a94d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.062300 Jul 28 10:39:00.913935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 195/407] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:39:00 2021] POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:39:00.923373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:00.923907 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:00.931091 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.931792 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:00.932781 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:00.933304 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.029669 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8fbb17a8-2b2e-4e73-95a0-fdd04ae1d4e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action" status: 202 len: 0 microversion: 2.1 time: 0.109018 Jul 28 10:39:01.031499 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 196/408] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:39:00 2021] POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:01.043314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:01.044271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:01.050250 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:01.058526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.059162 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e8dbf0b2-83bb-496b-b7fd-30246fcdc1cd tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1505 microversion: 2.1 time: 0.215661 Jul 28 10:39:01.059651 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.060475 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.060964 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.065470 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 213/409] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:00 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:01.074308 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:01.074899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:01.107174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.109297 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.112158 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.112547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.288545 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:01.297742 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bf6c1ba4-9544-432e-af43-974ccc2539d4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1510 microversion: 2.1 time: 0.231032 Jul 28 10:39:01.298455 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 214/410] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:01 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:01.305083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-884a371f-126e-4d73-b32a-12d6ee004091 req-f252d168-8f7e-4e16-9d5c-ad11d94c7edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:01.307325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:01.307325 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:39:01.315609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-884a371f-126e-4d73-b32a-12d6ee004091 req-f252d168-8f7e-4e16-9d5c-ad11d94c7edc service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.316502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-884a371f-126e-4d73-b32a-12d6ee004091 req-f252d168-8f7e-4e16-9d5c-ad11d94c7edc service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.319762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:01.332962 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f3de55a0-6314-402c-8787-c215f3f7d3d3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.298456 Jul 28 10:39:01.334320 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 197/411] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:01 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:01.340422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b5b1484-e0ea-4468-a993-332dbb4f37cc"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:01.342932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:01.345177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-884a371f-126e-4d73-b32a-12d6ee004091 req-f252d168-8f7e-4e16-9d5c-ad11d94c7edc service nova] Creating event network-changed:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:39:01.351922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.352574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.353452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.353925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.360765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-884a371f-126e-4d73-b32a-12d6ee004091 req-f252d168-8f7e-4e16-9d5c-ad11d94c7edc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060370 Jul 28 10:39:01.361901 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 215/412] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:01.547829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:01.548898 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:01.555479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.555927 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.556967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.557430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.778005 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fd608ba2-1d0a-45fb-85a4-d834c1c3e01c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 36507 microversion: 2.20 time: 0.233989 Jul 28 10:39:01.782457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 216/413] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:01 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 36507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:01.801369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-41169f7d-6aea-4a8d-b814-87ab74d730a5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464950 Jul 28 10:39:01.807705 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 198/414] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:39:01 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:01.840554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:01.841522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:01.849457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.850032 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.851394 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:01.851926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:01.916342 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:01.924671 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7ec0dd34-9240-447a-9dba-ea485e8d6abc tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1270 microversion: 2.1 time: 0.088633 Jul 28 10:39:01.925320 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 217/415] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:01 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:02.077338 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:02.078060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:02.086427 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.086867 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.087669 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.088101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.351332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:02.352292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:02.358879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.359488 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.360617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.361110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.571661 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:02.579467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-187adfe8-0b07-4b1d-b3cd-942de5af1111 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.232714 Jul 28 10:39:02.580139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 218/416] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:02 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:02.585049 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:02.585886 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:02.592333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.592964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.593838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.594372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.726774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:02.736955 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ee92b104-8285-4f79-8090-7da51b03f88d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1505 microversion: 2.1 time: 0.663581 Jul 28 10:39:02.737898 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 199/417] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:02 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:02.792009 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:02.794248 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:02.800039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:02.806597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.807300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.808225 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.808831 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.815796 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d9e971ab-3ab8-4d40-a900-77e7fc9974f4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1510 microversion: 2.1 time: 0.234639 Jul 28 10:39:02.816380 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 219/418] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:02 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:02.946038 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:02.946820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:02.969258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.970053 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:02.970951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:02.971907 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.014906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fd20dd14-9779-4a41-bc2d-3718fe135d03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 37401 microversion: 2.20 time: 0.228151 Jul 28 10:39:03.019060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 200/419] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:02 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 37401 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:03.054808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:03.062344 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-37e7bdd0-ad0a-4ba1-b3c2-0858f70b4396 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1276 microversion: 2.1 time: 0.122056 Jul 28 10:39:03.062916 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 220/420] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:02 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:03.382755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-08b1e34f-6764-477b-bb08-9dd9b55d1041 req-a93a3e28-420a-46b1-9e90-404e68f21bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f96299-0e89-4e9c-91e0-918a6776374b", "name": "network-vif-deleted", "tag": "22dde497-86e4-4d95-9b10-53c6d60e55dc"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:03.385498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:03.385498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:03.393834 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-08b1e34f-6764-477b-bb08-9dd9b55d1041 req-a93a3e28-420a-46b1-9e90-404e68f21bcd service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.396267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-08b1e34f-6764-477b-bb08-9dd9b55d1041 req-a93a3e28-420a-46b1-9e90-404e68f21bcd service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.408341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-08b1e34f-6764-477b-bb08-9dd9b55d1041 req-a93a3e28-420a-46b1-9e90-404e68f21bcd service nova] Creating event network-vif-deleted:22dde497-86e4-4d95-9b10-53c6d60e55dc for instance 29f96299-0e89-4e9c-91e0-918a6776374b on hv-cinder-80043 Jul 28 10:39:03.414361 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-08b1e34f-6764-477b-bb08-9dd9b55d1041 req-a93a3e28-420a-46b1-9e90-404e68f21bcd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036060 Jul 28 10:39:03.415510 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 201/421] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:03.596798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:03.597786 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:03.604176 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.604699 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.605567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.606072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.754410 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:03.755142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:03.761413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.761865 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.762639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.763078 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.789930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:03.793987 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.794436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.794884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lazy-loading 'fault' on Instance uuid 29f96299-0e89-4e9c-91e0-918a6776374b {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:39:03.797884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7282effa-1612-4d5c-9fb3-c1204699583f tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.205070 Jul 28 10:39:03.798870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 221/422] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:03 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:03.833517 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:03.834411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:03.840109 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.840690 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.841800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:03.842299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:03.843979 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287bf80d7a0d49e4a049c76ba95ebafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ffd5aee604675b6633eb88efb3dfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:03.855954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-108fab50-fc69-45cd-95d9-a3f468bde71d tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 200 len: 1304 microversion: 2.1 time: 0.105350 Jul 28 10:39:03.866402 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 202/423] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:03 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:04.027490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:04.028402 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:04.034400 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.034844 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.036210 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.037933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.066177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:04.076948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a67ef893-1069-4ea5-b5bd-1b1b3f9a615e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1510 microversion: 2.1 time: 0.247179 Jul 28 10:39:04.079190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 222/424] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:03 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:04.086465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:04.088044 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:04.095244 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.096214 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.097110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.097785 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.193236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-61d2b6a9-6a61-4654-8df7-1204f22f3ce2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 37876 microversion: 2.20 time: 0.169032 Jul 28 10:39:04.197431 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 203/425] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:04 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 37876 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:39:04.198778 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-8dc2d336-9a61-4740-8652-2ddb3005d696 req-e9b85a30-02c5-4da1-8285-4275aa063a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f45882a-c3fe-4e47-87d5-7f12f014c6b1", "tag": "a5cc4b22-565b-4fde-a3a1-c8469173d270"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:04.200232 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:04.200232 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:04.207647 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-8dc2d336-9a61-4740-8652-2ddb3005d696 req-e9b85a30-02c5-4da1-8285-4275aa063a68 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.208630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-8dc2d336-9a61-4740-8652-2ddb3005d696 req-e9b85a30-02c5-4da1-8285-4275aa063a68 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.219794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-8dc2d336-9a61-4740-8652-2ddb3005d696 req-e9b85a30-02c5-4da1-8285-4275aa063a68 service nova] Creating event network-changed:a5cc4b22-565b-4fde-a3a1-c8469173d270 for instance 2f45882a-c3fe-4e47-87d5-7f12f014c6b1 on hv-cinder-80043 Jul 28 10:39:04.231201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-8dc2d336-9a61-4740-8652-2ddb3005d696 req-e9b85a30-02c5-4da1-8285-4275aa063a68 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036001 Jul 28 10:39:04.232763 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 204/426] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:04.266499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:04.274612 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fc67a290-8eba-4058-b02b-5ac470815a32 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.193647 Jul 28 10:39:04.275173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 223/427] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:04 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:04.816444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:04.817169 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:04.823868 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.824318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.825135 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.825560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.874208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:04.875422 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] [instance: 29f96299-0e89-4e9c-91e0-918a6776374b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:04.882316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.882974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.883764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:04.884316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:04.899448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] HTTP exception thrown: Instance 29f96299-0e89-4e9c-91e0-918a6776374b could not be found. Jul 28 10:39:04.900050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] Returning 404 to user: Instance 29f96299-0e89-4e9c-91e0-918a6776374b could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:39:04.901047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6cd1bb54-2869-4264-b994-d79dac6afac9 tempest-VolumesActionsTest-1297967410 tempest-VolumesActionsTest-1297967410-project] 10.222.0.25 "GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b" status: 404 len: 111 microversion: 2.1 time: 0.030836 Jul 28 10:39:04.901603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 224/428] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:04 2021] GET /compute/v2.1/servers/29f96299-0e89-4e9c-91e0-918a6776374b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:39:04.949501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:04.958440 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-54a220cd-c76b-4202-b361-758ad6d29b7c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.145815 Jul 28 10:39:04.959376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 205/429] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:04 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:05.069358 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a812499b-80a9-4280-9f81-49a07af32bd3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:05.079502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a812499b-80a9-4280-9f81-49a07af32bd3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.079947 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a812499b-80a9-4280-9f81-49a07af32bd3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.094804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:05.095415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:05.103416 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.104140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.105396 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.106061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.148545 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a812499b-80a9-4280-9f81-49a07af32bd3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Going to try to stop instance {{(pid=119120) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 28 10:39:05.198445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a812499b-80a9-4280-9f81-49a07af32bd3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 202 len: 0 microversion: 2.1 time: 0.134305 Jul 28 10:39:05.199439 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 225/430] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:39:05 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:05.208544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:05.214974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:05.224083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.224802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.225686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.226121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.252538 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:05.260735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e3cb6af0-0635-415d-b75a-e8514083801e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1510 microversion: 2.1 time: 0.169524 Jul 28 10:39:05.261329 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 206/431] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:05 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:05.265712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:05.266513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:05.272804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.273506 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.274466 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.274894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.349284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6d0f47e1-ae1f-4b0f-9303-892c92151631 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 38162 microversion: 2.20 time: 0.144217 Jul 28 10:39:05.350144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 226/432] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:05 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 38162 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:05.356111 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:05.357162 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:05.366081 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.366081 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.366665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.367087 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.426415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:05.434842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2dfbfc27-3745-49af-934e-f36e5f2fe365 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.172305 Jul 28 10:39:05.435593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 207/433] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:05 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:05.542168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:05.550116 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c334475c-dbd6-4dd9-a0e1-48272dad8e1d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.198561 Jul 28 10:39:05.550673 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 227/434] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:05 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:05.975735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:05.976358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:05.982328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.982716 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:05.983477 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:05.983909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.100160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:06.107395 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-103657ab-9b41-469e-bc86-3878cbf63299 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.135924 Jul 28 10:39:06.107964 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 208/435] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:05 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:06.277618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:06.278161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:06.283962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.284407 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.285197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.285629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.362135 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:06.363112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:06.369721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.370167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.370932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.371363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.407694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:06.415740 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-52f0e202-437f-48bd-a4ab-9a1c39d746cf tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1516 microversion: 2.1 time: 0.141840 Jul 28 10:39:06.416299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 228/436] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:06 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1516 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:06.453016 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:06.453703 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:06.460295 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.460840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.461644 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.462091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.592084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:06.600842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8b189c3c-2dee-444b-baa3-629c1b7fdecf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.151332 Jul 28 10:39:06.601760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 229/437] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:06 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:06.601760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:06.601760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:06.612276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.612701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.613466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:06.614000 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:06.756092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:06.763381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-274bf964-bc8d-49ca-9241-e1d005eb113c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.160677 Jul 28 10:39:06.763939 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 230/438] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:06 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:07.124452 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:07.125099 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:07.131431 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:07.131871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:07.132636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:07.133096 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:07.252635 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:07.260424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f3f63553-555e-45c2-82ab-20d7b061710b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.139829 Jul 28 10:39:07.261018 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 231/439] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:07 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:07.619239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:07.619848 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:07.626001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:07.626445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:07.627204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:07.627637 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:07.747577 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:07.755309 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7c3d2d53-9111-441b-8aae-f7970e7e1705 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.139606 Jul 28 10:39:07.755887 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 232/440] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:07 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:07.779890 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:07.780501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:07.787310 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:07.787755 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:07.788537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:07.789008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:07.908389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:07.916455 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-be517e6a-b250-4d2a-9317-4f03eca94964 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.140005 Jul 28 10:39:07.917058 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 233/441] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:07 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:08.277048 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:08.277586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:08.283393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:08.283843 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:08.284609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:08.285068 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:08.405239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:08.412853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-704c8793-2fbe-4da0-9c2f-1f3095e2d75a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.139476 Jul 28 10:39:08.413416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 234/442] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:08 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:08.772315 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:08.772987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:08.778729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:08.779176 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:08.779972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:08.780406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:08.899513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:08.907207 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-30bfb6c0-a787-4422-b008-31f164061b23 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.138551 Jul 28 10:39:08.907766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 235/443] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:08 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:08.932964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:08.933579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:08.939178 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:08.939625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:08.940385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:08.940848 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:09.059153 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:09.067182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-befc6657-5b9e-4fbd-9d73-1fa999845301 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.136777 Jul 28 10:39:09.067770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 236/444] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:08 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:09.071076 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8a032f53-4345-4b98-9b5a-270ba1bf2d65 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 200 len: 38305 microversion: 2.20 time: 2.712455 Jul 28 10:39:09.072284 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 209/445] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:06 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 38305 bytes in 2714 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:39:09.081395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:09.081894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:09.087816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:09.088262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:09.089055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:09.089501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:09.113572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d152abe1-bb10-4180-909f-10b3c0a5f0a8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/ips" status: 200 len: 152 microversion: 2.20 time: 0.035681 Jul 28 10:39:09.114192 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 237/446] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Jul 28 10:39:09 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:39:09.430353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:09.431086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:09.437606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:09.438214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:09.438989 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:09.439429 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:09.560823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:09.568988 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-58a0319b-a467-4ffb-97a6-a3a8cfc5c52d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.142811 Jul 28 10:39:09.569557 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 210/447] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:09 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:09.924389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:09.925021 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:09.931444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:09.931899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:09.932658 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:09.933114 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:10.055853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:10.063552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2b4d99e6-962d-4587-b653-447353f84048 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.142703 Jul 28 10:39:10.064052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 238/448] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:09 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:10.082924 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:10.083561 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:10.090235 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:10.090773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:10.091571 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:10.092001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:10.213734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:10.220825 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-376038bc-fdc6-4515-88f0-f8010cddcfe9 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.141437 Jul 28 10:39:10.221395 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 211/449] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:10 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:10.586244 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:10.586859 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:10.592812 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:10.593258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:10.594135 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:10.594652 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:10.721273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:10.729262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-95d6ad78-a5a7-452b-9440-83c9fe510915 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.147501 Jul 28 10:39:10.729865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 239/450] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:10 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:10.899843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:10.900457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:10.906710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:10.907154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:10.908092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:10.908528 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.062556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:11.071900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-96f32c0e-271f-44ce-a83b-fa72f242f323 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1516 microversion: 2.1 time: 0.175799 Jul 28 10:39:11.073028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 212/451] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:10 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:11.086894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:11.087767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:11.090770 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a24ebc5-333f-41e5-8689-342dc8db1b55"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:11.092069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:11.098481 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.099038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.100128 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.100764 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.106922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.107686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.108973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.109621 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.274208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:11.282923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ad07ff1a-1052-4b9e-bdf8-80cbb94266a2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.205055 Jul 28 10:39:11.283544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 240/452] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:11 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:11.289922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:11.290835 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:11.297289 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.298090 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.299177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.299731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.435893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5121352b-7617-4488-9862-ed2eb9aca6e9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350110 Jul 28 10:39:11.436583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 213/453] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:39:11 2021] POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:11.445761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:11.454636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fe06c813-2b04-477a-a3dc-db4e1f50c7fe tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.168259 Jul 28 10:39:11.458560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:11.459687 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:11.464445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 241/454] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:11 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:11.470496 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.471200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.472200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.473279 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.511282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lazy-loading 'flavor' on Instance uuid cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:39:11.745716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:11.746689 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:11.753211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.754334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.755356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.758237 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.897803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b13653ed-fa1c-402b-9d46-f58e62d3bf6e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 202 len: 0 microversion: 2.20 time: 0.459527 Jul 28 10:39:11.898803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 214/455] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:11 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:11.920919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:11.921634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:11.934288 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.936228 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.939123 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:11.940325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:11.955879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:11.964838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-74582ad2-2a8f-4d9e-bd3e-bf4e632bcf59 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.222530 Jul 28 10:39:11.965606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 242/456] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:11 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:12.088530 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:12.096421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:12.099363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:12.101564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bd3c9275-d60d-434c-9dcc-70c3ef78ce89 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.197120 Jul 28 10:39:12.105082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 215/457] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:11 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:12.300828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:12.301466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:12.307441 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:12.307912 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:12.308672 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:12.309132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:12.439860 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:12.448615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-be04d14e-a024-4598-843d-87f9fca195eb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.151544 Jul 28 10:39:12.449239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 243/458] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:12 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:12.471416 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:12.472133 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:12.480824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:12.481383 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:12.482278 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:12.482809 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:12.673100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:12.681169 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ca082e9e-b149-43fa-9de3-25909048028e tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.213403 Jul 28 10:39:12.681739 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 216/459] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:12 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:12.981997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:12.982652 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:12.988489 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:12.989260 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:12.990267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:12.990868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.139619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:13.140267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:13.151251 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:13.151869 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.152878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:13.153339 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.214264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:13.222056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-109d7198-72ac-45e9-97e7-a912276abf82 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.243645 Jul 28 10:39:13.224411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 244/460] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:12 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:13.338476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:13.347755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:13.351250 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:13.353182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4b5886c0-4680-4979-909a-b41f63735324 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.222674 Jul 28 10:39:13.354220 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 217/461] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:13 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:13.465960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:13.466522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:13.472727 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:13.473435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.474366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:13.475490 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.625992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:13.639934 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-77027649-12b7-4154-add6-9616141d1125 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.177733 Jul 28 10:39:13.641107 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 245/462] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:13 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:13.699425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:13.700073 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:13.714951 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:13.715431 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.716304 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:13.716782 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:13.863609 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:13.872722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-284b315c-b843-414d-acb9-6bd49f5411cf tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.176698 Jul 28 10:39:13.882413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 218/463] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:13 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:14.251010 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:14.251535 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:14.258268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.258719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.259489 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.259929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.372235 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:14.373212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:14.384034 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.387506 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.388932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.389393 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.407883 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:14.420023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b3c7e15a-e3ae-4b53-8261-2b6318f769c2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.182832 Jul 28 10:39:14.421551 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 246/464] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:14 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:14.537115 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:14.546157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:14.547663 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:14.548823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f91ba1ce-0d87-4122-a558-a995f1ae7497 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.181022 Jul 28 10:39:14.550101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 219/465] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:14 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:14.658277 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:14.659012 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:14.665782 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.666473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.667441 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.668024 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.813499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:14.822833 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ed398630-ff53-4355-bf00-de2787cb9fdf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.168290 Jul 28 10:39:14.823770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 247/466] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:14 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:14.889536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:14.890491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:14.897446 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.898123 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:14.899021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:14.899576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.050319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:15.065311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-891edc29-2482-4c93-ad66-dc425c5c7cdd tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.179179 Jul 28 10:39:15.065829 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 220/467] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:14 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:15.439619 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:15.440177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:15.446396 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.446843 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.447612 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.448042 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.568131 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:15.569787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:15.573459 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:15.581570 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0a16e064-34dc-483e-a945-1b9c5fcbfaca tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.145727 Jul 28 10:39:15.591432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.591820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 248/468] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:15 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:15.593308 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.596313 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.596791 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.809491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:15.822447 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:15.823961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:15.825151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8b81a928-f27c-42f8-ac0f-fc0901a1faf0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.260707 Jul 28 10:39:15.839166 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 221/469] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:15 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:15.844528 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:15.845299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:15.854127 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-7ea3acb6-f080-4520-8b99-3af68d407b3c req-9fd8d6cd-bce1-45fa-9f93-98608e244e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f45882a-c3fe-4e47-87d5-7f12f014c6b1", "name": "network-vif-plugged", "status": "completed", "tag": "a5cc4b22-565b-4fde-a3a1-c8469173d270"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:15.856589 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.856792 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:15.856792 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:15.858273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.858626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.859063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.867034 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-7ea3acb6-f080-4520-8b99-3af68d407b3c req-9fd8d6cd-bce1-45fa-9f93-98608e244e7e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:15.867820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-7ea3acb6-f080-4520-8b99-3af68d407b3c req-9fd8d6cd-bce1-45fa-9f93-98608e244e7e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:15.880180 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-7ea3acb6-f080-4520-8b99-3af68d407b3c req-9fd8d6cd-bce1-45fa-9f93-98608e244e7e service nova] Creating event network-vif-plugged:a5cc4b22-565b-4fde-a3a1-c8469173d270 for instance 2f45882a-c3fe-4e47-87d5-7f12f014c6b1 on hv-cinder-80043 Jul 28 10:39:15.886820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-7ea3acb6-f080-4520-8b99-3af68d407b3c req-9fd8d6cd-bce1-45fa-9f93-98608e244e7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037944 Jul 28 10:39:15.889738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 222/470] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:16.023518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:16.048697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-91c27b54-b9a8-4fde-bb3b-272553ed2348 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.207863 Jul 28 10:39:16.055925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 249/471] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:15 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:16.084987 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:16.086162 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:16.097742 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:16.100858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:16.101927 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:16.102591 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:16.269624 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:16.284256 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4a0bc366-d4c0-47e7-a8d8-a5eee26651a1 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.200027 Jul 28 10:39:16.294670 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 223/472] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:16 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:16.599064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:16.600014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:16.606281 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:16.606806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:16.607894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:16.608401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:16.754128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:16.767938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5cbacbbc-a09f-414f-9de6-d263403443e8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.172628 Jul 28 10:39:16.769132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 250/473] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:16 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:16.850862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:16.852326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:16.859198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:16.859914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:16.860890 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:16.861492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.003429 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:17.012765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:17.014384 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:17.015597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0a26a3c2-6390-4c0f-aeaa-75627af8870d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.168998 Jul 28 10:39:17.025281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 224/474] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:16 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:17.072370 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:17.073626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:17.081022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.081480 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.082443 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.083092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.277888 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:17.288269 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6ba74972-57f2-4c51-81d7-8c30fabbed92 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.220272 Jul 28 10:39:17.298272 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 251/475] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:17 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:17.312184 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:17.312849 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:17.319773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.319773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.320500 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.322515 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.460674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:17.468090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-afcf0131-f4ca-4bec-b4ba-620db211c7a4 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.159568 Jul 28 10:39:17.468792 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 225/476] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:17 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:17.785282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:17.786164 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:17.792638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.793242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.794281 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.795152 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.937023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-22a9ff09-a4d6-4b20-b218-198a9e59bb65 req-9a2ba3de-7e7c-42be-973c-d4450f655863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:17.940250 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:17.940250 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:17.949375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-22a9ff09-a4d6-4b20-b218-198a9e59bb65 req-9a2ba3de-7e7c-42be-973c-d4450f655863 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:17.950297 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-22a9ff09-a4d6-4b20-b218-198a9e59bb65 req-9a2ba3de-7e7c-42be-973c-d4450f655863 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:17.965440 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-22a9ff09-a4d6-4b20-b218-198a9e59bb65 req-9a2ba3de-7e7c-42be-973c-d4450f655863 service nova] Creating event network-vif-plugged:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:39:17.971132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-22a9ff09-a4d6-4b20-b218-198a9e59bb65 req-9a2ba3de-7e7c-42be-973c-d4450f655863 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039752 Jul 28 10:39:17.972178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 226/477] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:39:17.988227 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:17.997693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fe86a0ef-faec-409c-a2ec-e792d5efaa2b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.215901 Jul 28 10:39:18.003942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 252/478] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:17 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:18.035530 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:18.036377 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:18.043490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:18.044198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:18.045118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:18.045765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:18.178888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:18.188077 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:18.190314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:18.191774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d4a39d04-9711-4c19-bd84-77aadde4df56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.160201 Jul 28 10:39:18.204008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 227/479] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:18 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:18.305488 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:18.306034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:18.311872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:18.312508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:18.313346 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:18.313784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:18.448870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:18.457066 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-54357ec1-b819-4c7a-bda3-5c82a22ac4a0 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.155317 Jul 28 10:39:18.457637 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 253/480] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:18 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:18.487570 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:18.489199 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:18.499633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:18.500679 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:18.502237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:18.502841 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:18.645797 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:18.656174 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2d52e9fa-e7b0-47ee-a2da-d6e263a1c928 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1318 microversion: 2.1 time: 0.174298 Jul 28 10:39:18.657521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 228/481] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:18 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:19.017826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.018426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:19.024910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.025597 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.026212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.026651 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.179739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:19.194190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fde6bd8b-c008-4569-b65b-64bafc5699c1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.179797 Jul 28 10:39:19.194770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 254/482] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:19 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:19.211445 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.212888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:19.219251 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.219802 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.220679 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.221221 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.359100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:19.367220 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:19.368830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:19.370228 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a92bd9e0-bbb8-43c0-a6c6-ab63b89a8a7e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.163170 Jul 28 10:39:19.370822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 229/483] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:19 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:19.476129 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.477458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:19.483372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.483821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.484606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.485064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.628869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:19.638147 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-acb0d8ce-4710-43ee-b32e-071533baf641 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.166621 Jul 28 10:39:19.638721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 255/484] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:19 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:19.674535 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:19.675140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:19.682337 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.682783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.683561 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:19.684075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:19.826545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:19.840486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6c72c33b-a02d-4821-bc52-59804bce8302 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1508 microversion: 2.1 time: 0.163486 Jul 28 10:39:19.841276 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 230/485] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:19 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:20.213154 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:20.214004 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:20.222663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:20.224571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:20.225603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:20.228451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:20.378659 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:20.386636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7528922e-de06-4553-94d3-2b214e029415 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1261 microversion: 2.1 time: 0.177896 Jul 28 10:39:20.387194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 256/486] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:20 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:20.389413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:20.390026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:20.395886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:20.396998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:20.397880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:20.398319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:20.520605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:20.528838 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:20.530325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:20.531446 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-91221834-36b5-41a6-a652-e08feec05cc2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.145740 Jul 28 10:39:20.531993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 231/487] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:20 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:20.659854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:20.660388 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:20.667704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:20.668271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:20.669575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:20.670037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:20.807512 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:20.815928 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5affc424-1a54-4fb3-8f24-3106ed003eae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.159692 Jul 28 10:39:20.816489 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 257/488] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:20 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:21.226889 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:21.228016 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:21.237923 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.238453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.239434 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.240119 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.274097 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lazy-loading 'flavor' on Instance uuid a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:39:21.318341 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1b6628b-04a0-418a-9ffd-bfa6266c527b"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:21.319768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:21.326414 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.326879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.327973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.328422 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.453944 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c85ed914-cffa-4e19-b701-5436f5a4abf7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action" status: 200 len: 32 microversion: 2.1 time: 0.232023 Jul 28 10:39:21.455253 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 232/489] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:39:21 2021] POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:39:21.465572 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:21.466404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:21.472903 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.473582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.475483 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.476212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.663446 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:21.686448 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-925eadbd-28ce-4510-be08-bf9c9ef02ea0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1446 microversion: 2.1 time: 0.224727 Jul 28 10:39:21.687273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 233/490] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:21 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:21.697769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:21.698490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:21.704925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.705678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.706696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.707282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.872068 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:21.881492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4f8470a2-5d27-4d51-81db-a9daed590d87 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.187399 Jul 28 10:39:21.882593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 234/491] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:21 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:21.887083 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:21.887694 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:21.893656 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.894238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.895019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.895458 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.903854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a453ed5f-bd39-4c7e-9484-c36565b48813 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "POST /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568961 Jul 28 10:39:21.904712 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 258/492] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:39:21 2021] POST /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:21.934835 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:21.937688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:21.954730 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.955269 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:21.957378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:21.960604 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:22.063061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:22.073355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:22.075065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:22.076945 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c9424240-6c5d-4fc8-9096-2dfb9f2e7e32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.192860 Jul 28 10:39:22.088894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 235/493] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:21 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:22.093612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:22.094354 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:22.101643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:22.102269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:22.103422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:22.103926 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:22.260319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:22.264806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:22.272379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c3bfa736-65a9-4f4c-acc5-f99c192cd415 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.182254 Jul 28 10:39:22.283318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 236/494] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:22 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:22.303546 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9eb85884-ce0f-4afd-81f7-7d8347cea508 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1446 microversion: 2.1 time: 0.382297 Jul 28 10:39:22.310986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 259/495] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:21 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1446 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:22.900406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:22.901773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:22.909902 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:22.910718 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:22.911920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:22.912957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:23.068812 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:23.078808 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-995bc591-4880-4e0c-81ff-b20230d264b9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.183094 Jul 28 10:39:23.079902 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 237/496] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:22 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:23.095429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:23.096204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:23.103409 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:23.104344 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:23.105496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:23.106146 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:23.289142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:23.290032 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:23.301837 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:23.302771 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:23.303386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:23.307863 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:23.478000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:23.490194 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0396c6d7-2fcf-4d16-be5c-aa016badba45 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.203397 Jul 28 10:39:23.502141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 238/497] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:23 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:23.510574 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:23.523917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:23.525739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:23.532097 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5b51be83-a765-4a1c-a195-4839adc5d9cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.440522 Jul 28 10:39:23.533246 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 260/498] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:23 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:24.096623 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:24.097369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:24.105498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.105498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.106378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.106734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.250973 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:24.260268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dc7a5d5f-a482-4dcb-8725-2ebc41955b57 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.167518 Jul 28 10:39:24.262069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 239/499] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:24 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:24.507513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:24.508882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:24.515048 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.515592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.516496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.517022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.552432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:24.555374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:24.560958 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.561707 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.562765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.563429 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.711743 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:24.722155 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3304446a-878d-461d-a882-ae93d7761d3c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.218390 Jul 28 10:39:24.723316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 261/500] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:24 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:24.729121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-2a8a39ba-bb59-4ef7-b086-d861bd1a81a8 req-980e437b-59a2-4e9b-b857-fd24f2dd2916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:24.731603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:24.731603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:39:24.739271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-2a8a39ba-bb59-4ef7-b086-d861bd1a81a8 req-980e437b-59a2-4e9b-b857-fd24f2dd2916 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:24.740602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-2a8a39ba-bb59-4ef7-b086-d861bd1a81a8 req-980e437b-59a2-4e9b-b857-fd24f2dd2916 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:24.748695 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:24.760154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:24.761386 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-2a8a39ba-bb59-4ef7-b086-d861bd1a81a8 req-980e437b-59a2-4e9b-b857-fd24f2dd2916 service nova] Creating event network-changed:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:39:24.762337 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:24.764520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9e69225a-a232-49ad-ac22-7fcd34a3fac0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.216610 Jul 28 10:39:24.767479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-2a8a39ba-bb59-4ef7-b086-d861bd1a81a8 req-980e437b-59a2-4e9b-b857-fd24f2dd2916 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042720 Jul 28 10:39:24.768542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 262/501] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:24.777517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 240/502] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:24 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:25.281504 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:25.282998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:25.292245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:25.292995 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:25.293950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:25.294569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:25.569232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:25.579363 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fd210260-9ba9-4515-8f81-96052cf6b499 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.304555 Jul 28 10:39:25.580863 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 263/503] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:25 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:25.740322 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:25.740960 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:25.747637 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:25.748089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:25.748925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:25.749537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:25.783427 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:25.784318 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:25.794533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:25.795095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:25.795960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:25.796590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:25.969591 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:25.979093 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-65e7e36a-430f-43da-b320-51525b64a6d4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1725 microversion: 2.1 time: 0.242014 Jul 28 10:39:25.982742 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 241/504] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:25 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:25.993372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:26.003295 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:26.004929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:26.006963 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d620d839-1835-4424-b54c-59ec0c92e917 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.227082 Jul 28 10:39:26.007764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 264/505] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:25 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:26.599839 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:26.600649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:26.607353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:26.608026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:26.608812 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:26.609459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:26.776492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:26.787918 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6ab40bee-8921-4ac2-9aff-9d2a9ee74880 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.192386 Jul 28 10:39:26.797794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 242/506] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:26 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:27.003616 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:27.004532 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:27.014970 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.015929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.016920 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.017357 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.025737 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:27.026354 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:27.032431 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.032914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.033692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.034126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.164246 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:27.172484 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:27.177933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:27.179573 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fb5adafd-3f96-4dfc-a739-36d333c3aac7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.158212 Jul 28 10:39:27.190740 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 243/507] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:27 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:27.219794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:27.228168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-53de31e6-f8d8-4745-a460-7d358b005601 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1702 microversion: 2.1 time: 0.230918 Jul 28 10:39:27.232354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 265/508] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:26 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1702 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:27.248345 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7d22929e-4cca-408c-8a30-3d231eb6be6f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:27.254976 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7d22929e-4cca-408c-8a30-3d231eb6be6f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.256141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7d22929e-4cca-408c-8a30-3d231eb6be6f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.317088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7d22929e-4cca-408c-8a30-3d231eb6be6f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Going to try to start instance {{(pid=119121) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 28 10:39:27.366700 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7d22929e-4cca-408c-8a30-3d231eb6be6f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 202 len: 0 microversion: 2.1 time: 0.123596 Jul 28 10:39:27.367639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 244/509] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:39:27 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:39:27.375872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:27.376731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:27.386350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.386938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.387757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.388383 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.529666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:27.539196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ca89d353-6304-47e5-a0d0-67bfaf706bbd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1711 microversion: 2.1 time: 0.167514 Jul 28 10:39:27.540049 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 266/510] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:27 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1711 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:27.806293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:27.806991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:27.813440 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.814092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.815521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:27.816561 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:27.996554 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:28.012340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2b5fd414-13b2-4293-8aba-743cc2511a8a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.210438 Jul 28 10:39:28.012952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 245/511] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:27 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:28.198544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:28.199830 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:28.206758 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:28.207195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:28.208273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:28.209334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:28.343800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:28.352061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:28.353613 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:28.354757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5e9fb870-233f-43af-a451-6987aab08fc7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.160218 Jul 28 10:39:28.355314 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 267/512] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:28 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:28.555441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:28.556049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:28.561946 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:28.562392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:28.563167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:28.563620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:28.706924 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:28.717178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-63ac85ff-967f-45fa-8cd4-abd36239c31a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1711 microversion: 2.1 time: 0.165572 Jul 28 10:39:28.717747 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 246/513] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:28 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1711 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:29.034587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:29.035122 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:29.041560 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:29.042013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:29.042786 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:29.043214 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:29.182050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:29.203186 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e34f5a49-8fdd-4445-a2c9-07141709e875 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.159786 Jul 28 10:39:29.205265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 268/514] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:29 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:29.373145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:29.374436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:29.380941 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:29.381396 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:29.382278 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:29.382703 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:29.522748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:29.532034 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:29.533988 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:29.535359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8a941535-b7a5-468a-8151-e24bb867a534 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.166283 Jul 28 10:39:29.536169 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 247/515] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:29 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:29.736116 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:29.736970 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:29.744987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:29.745432 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:29.746199 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:29.746764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:29.889632 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:29.899333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-97720da6-2510-40ac-a005-1cbc5b46d7f1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1711 microversion: 2.1 time: 0.168681 Jul 28 10:39:29.899988 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 269/516] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:29 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:30.220193 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:30.220840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:30.227081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.227526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.228287 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.228716 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.346797 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:30.354524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4a959d14-1398-4bcb-908e-abb2b4d86964 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.138024 Jul 28 10:39:30.355086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 248/517] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:30 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:30.553322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:30.553966 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:30.559878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.560320 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.561143 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.561575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.694302 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:30.714001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:30.715561 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:30.716704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b09b93e9-de92-4c6a-95ad-b6c0f193b6bd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.167859 Jul 28 10:39:30.726370 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 270/518] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:30 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:30.726473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:30.726473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:30.726473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.727093 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.727360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.727903 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.817648 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lazy-loading 'services' on Instance uuid 2f45882a-c3fe-4e47-87d5-7f12f014c6b1 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:39:30.887370 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-75cac83b-11c8-48b8-8eb4-13c725f8a94f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1/os-volume_attachments/c1b6628b-04a0-418a-9ffd-bfa6266c527b" status: 202 len: 0 microversion: 2.1 time: 0.172146 Jul 28 10:39:30.888269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 249/519] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:39:30 2021] DELETE /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1/os-volume_attachments/c1b6628b-04a0-418a-9ffd-bfa6266c527b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:39:30.919418 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:30.920986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:30.927937 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.928559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:30.929371 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:30.929794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:31.072454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:31.080385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-79ddfb40-5f1d-4b4d-9838-3df28ad47322 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1715 microversion: 2.1 time: 0.166997 Jul 28 10:39:31.080978 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 271/520] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:30 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:31.372133 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:31.373023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:31.379124 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:31.379569 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:31.380921 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:31.381817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:31.510852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:31.519165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8d0f92fd-2cc4-4e2c-9071-d0fe75ab7ccd tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.151353 Jul 28 10:39:31.519729 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 250/521] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:31 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:31.737700 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:31.738308 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:31.744775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:31.745232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:31.745998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:31.746433 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:31.871535 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:31.879414 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:31.882068 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:31.883189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ad27578d-1262-4a62-b516-083f14a56152 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.149225 Jul 28 10:39:31.883756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 272/522] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:31 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:32.537175 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:32.538064 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:32.543953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:32.544487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:32.545363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:32.545791 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:32.750994 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:32.758774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2507f526-134c-4e97-9058-4d3a4069e153 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.225854 Jul 28 10:39:32.759346 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 251/523] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:32 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:32.902636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:32.903380 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:32.909703 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:32.910155 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:32.910917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:32.911351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:33.032580 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:33.041757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:33.043872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:33.045603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fea5162e-f1e1-4f33-b1ed-6577f85d4d85 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.147371 Jul 28 10:39:33.052671 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 273/524] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:32 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:33.775982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:33.777918 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:33.784094 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:33.784719 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:33.785590 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:33.786122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:33.909630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:33.918029 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2f510183-e4fd-49a6-935a-a7971fa66b9f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.145896 Jul 28 10:39:33.918683 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 252/525] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:33 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:34.068009 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:34.069161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:34.075742 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.076192 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.077187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.077630 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.210818 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:34.218946 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:34.220451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:34.221618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-49253af1-ae28-4e2c-abd9-51067dcffffe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1746 microversion: 2.20 time: 0.160556 Jul 28 10:39:34.222436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 274/526] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:34 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:34.228689 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:34.229216 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:34.235292 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.235742 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.236516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.237060 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.261422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:39:34.335926 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4ef05056-b436-433f-89d6-240d7dc0c713 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 204 len: 0 microversion: 2.1 time: 0.111912 Jul 28 10:39:34.336513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 253/527] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:39:34 2021] DELETE /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:34.344589 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:34.345230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:34.351352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.351736 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.352532 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.353006 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.474008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:34.481604 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f41c12c5-99be-440f-bf4a-69f9d3b19c5f tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1514 microversion: 2.1 time: 0.140885 Jul 28 10:39:34.482172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 275/528] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:34 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:34.935851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:34.936554 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:34.942474 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.943010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:34.943779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:34.944206 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:35.066663 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:35.075871 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-82c607df-b9f6-49c9-b394-eabae61de4c8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.143930 Jul 28 10:39:35.076783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 254/529] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:34 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:35.240890 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:35.241502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:35.247557 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:35.248012 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:35.248784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:35.249215 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:35.373136 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:35.381389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:35.382871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:35.383989 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-888e2d7a-aca0-489f-9726-5ecb25dab1e1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1746 microversion: 2.20 time: 0.147039 Jul 28 10:39:35.384542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 276/530] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:35 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:35.498205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:35.498820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:35.504659 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:35.505768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:35.506660 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:35.507100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:35.625931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:35.633796 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5d980919-98d4-4c19-883f-fc68de251aa7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1514 microversion: 2.1 time: 0.139434 Jul 28 10:39:35.634370 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 255/531] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:35 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:36.094451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:36.094981 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:36.101567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:36.102011 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:36.102761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:36.103189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:36.225954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:36.234348 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-49db743d-7905-4b74-9f2f-28d177801940 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.143499 Jul 28 10:39:36.235331 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 277/532] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:36 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:36.401408 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:36.402083 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:36.408721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:36.409055 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:36.410007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:36.410442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:36.553215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:36.563104 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:36.564622 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:36.565801 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d863ae25-4865-453a-87da-01cd220b24e8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.168054 Jul 28 10:39:36.566364 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 256/533] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:36 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:36.652063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:36.653293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:36.661678 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:36.662183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:36.663365 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:36.663971 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:36.803958 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:36.811317 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cacfa418-7df4-4feb-b2aa-9396e8547271 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1514 microversion: 2.1 time: 0.163585 Jul 28 10:39:36.811883 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 278/534] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:36 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:37.255500 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:37.256498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:37.269542 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:37.270312 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:37.273945 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:37.274707 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:37.464058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:37.479778 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a372b708-8efd-4e1d-8a3b-8d435744260b tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.229339 Jul 28 10:39:37.491118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 257/535] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:37 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:37.586496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:37.587643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:37.596795 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:37.597799 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:37.598872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:37.599986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:37.831254 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:37.832032 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:37.847612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:37.848434 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:37.851125 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:37.853132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:37.871319 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:37.885867 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:37.887644 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:37.890391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-29685185-7096-4c05-b4cb-3f0ab4daf0d1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.308492 Jul 28 10:39:37.904550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 279/536] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:37 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:37.988379 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-140d1a27-0a2a-4033-9b1e-f5b19208b904 req-a6562d81-979f-44bd-b365-f3b36f4e8fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "name": "network-vif-plugged", "status": "completed", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:37.991536 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:37.991536 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:39:38.006196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-140d1a27-0a2a-4033-9b1e-f5b19208b904 req-a6562d81-979f-44bd-b365-f3b36f4e8fdc service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:38.006638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-140d1a27-0a2a-4033-9b1e-f5b19208b904 req-a6562d81-979f-44bd-b365-f3b36f4e8fdc service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:38.031751 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-140d1a27-0a2a-4033-9b1e-f5b19208b904 req-a6562d81-979f-44bd-b365-f3b36f4e8fdc service nova] Creating event network-vif-plugged:602fc625-de40-4d7c-8ac1-0c239e6258a7 for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b on hv-cinder-80043 Jul 28 10:39:38.037686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-140d1a27-0a2a-4033-9b1e-f5b19208b904 req-a6562d81-979f-44bd-b365-f3b36f4e8fdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052522 Jul 28 10:39:38.038764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 280/537] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:39:38.079118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:38.092349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-92caa76a-e46c-4180-87cc-7873132956f6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 200 len: 1514 microversion: 2.1 time: 0.266717 Jul 28 10:39:38.093671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 258/538] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:37 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:38.173768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-61923de4-1ad5-4169-92b5-7b4e3b694725 req-cb68dcb6-d408-4815-bb41-5f25f15ce8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f45882a-c3fe-4e47-87d5-7f12f014c6b1", "name": "network-vif-deleted", "tag": "a5cc4b22-565b-4fde-a3a1-c8469173d270"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:38.175424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:38.175424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:39:38.185080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-61923de4-1ad5-4169-92b5-7b4e3b694725 req-cb68dcb6-d408-4815-bb41-5f25f15ce8a8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:38.185608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-61923de4-1ad5-4169-92b5-7b4e3b694725 req-cb68dcb6-d408-4815-bb41-5f25f15ce8a8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:38.209472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-61923de4-1ad5-4169-92b5-7b4e3b694725 req-cb68dcb6-d408-4815-bb41-5f25f15ce8a8 service nova] Creating event network-vif-deleted:a5cc4b22-565b-4fde-a3a1-c8469173d270 for instance 2f45882a-c3fe-4e47-87d5-7f12f014c6b1 on hv-cinder-80043 Jul 28 10:39:38.214521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-61923de4-1ad5-4169-92b5-7b4e3b694725 req-cb68dcb6-d408-4815-bb41-5f25f15ce8a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044904 Jul 28 10:39:38.219063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 281/539] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:38.497970 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:38.498562 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:38.505226 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:38.505688 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:38.506464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:38.506899 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:38.642189 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:38.651546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ebd7c68f-0738-4c96-ae73-4e62193e5a80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.157361 Jul 28 10:39:38.652126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 259/540] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:38 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:38.915227 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:38.916073 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:38.923332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:38.923884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:38.924722 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:38.925247 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:39.064554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:39.074091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:39.076183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:39.077771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e0dd4fd1-ac69-430c-a01e-2472c9072b63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.169966 Jul 28 10:39:39.080271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 282/541] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:38 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:39.109934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:39.110704 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 2f45882a-c3fe-4e47-87d5-7f12f014c6b1] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:39.119555 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:39.120511 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:39.121598 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:39.122142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:39.137610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] HTTP exception thrown: Instance 2f45882a-c3fe-4e47-87d5-7f12f014c6b1 could not be found. Jul 28 10:39:39.138459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Returning 404 to user: Instance 2f45882a-c3fe-4e47-87d5-7f12f014c6b1 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:39:39.139350 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-03a4fdfc-d304-4756-83c1-80ce8acd09a8 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1" status: 404 len: 111 microversion: 2.1 time: 0.033326 Jul 28 10:39:39.139996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 260/542] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:39 2021] GET /compute/v2.1/servers/2f45882a-c3fe-4e47-87d5-7f12f014c6b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:39.669261 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:39.669882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:39.679193 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:39.679648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:39.681077 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:39.681642 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:39.841462 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:39.849615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7bc87ed5-3dd3-44e8-8ff2-6b0da74277c5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.184507 Jul 28 10:39:39.850413 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 283/543] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:39 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:40.103332 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:40.104628 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:40.111113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.111623 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.112617 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.113849 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.260934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:40.271605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:40.273182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:40.274332 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1e26cc3a-555c-4d71-9c0d-09178837e84f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.177797 Jul 28 10:39:40.284803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 261/544] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:40 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:40.287623 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:40.288251 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:40.294666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.295114 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.295900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.296317 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.322873 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:39:40.415542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b5fdedfd-b43a-489c-8626-353c945655e6 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 204 len: 0 microversion: 2.1 time: 0.130983 Jul 28 10:39:40.419869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 284/545] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:39:40 2021] DELETE /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:40.425531 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:40.426214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:40.437642 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.438087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.438895 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.439344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.576044 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:40.586158 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a173f50f-d27d-4fbb-afb6-240e3fc0a92b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1513 microversion: 2.1 time: 0.165304 Jul 28 10:39:40.587227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 262/546] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:40 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:40.868669 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:40.869774 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:40.877331 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.877915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:40.878798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:40.879337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:41.011873 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:41.020105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c62f1edc-b2f7-4c25-bb90-d6d1b89c3314 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.157223 Jul 28 10:39:41.021240 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 285/547] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:40 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:41.294171 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:41.294711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:41.301126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:41.301570 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:41.302374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:41.302804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:41.444428 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:41.453690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:41.455713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:41.456993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b00bfbfb-ec9c-49e1-a881-544de70a9ebe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.166903 Jul 28 10:39:41.457922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 263/548] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:41 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:41.603654 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:41.605021 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:41.611089 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:41.611620 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:41.612472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:41.613003 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:41.756603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:41.789403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-642e90c8-c5cb-4b5c-8e9b-ca968dcfc8a2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1513 microversion: 2.1 time: 0.189547 Jul 28 10:39:41.790150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 286/549] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:41 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:42.038769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:42.039492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:42.046325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:42.047556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:42.048353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:42.048818 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:42.204095 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:42.212415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b5cc0bb9-7ffe-4f4d-bcd5-bf0f3329a422 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.178226 Jul 28 10:39:42.213264 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 264/550] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:42 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:42.478335 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:42.478859 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:42.485084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:42.485559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:42.486327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:42.486760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:42.624706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:42.633985 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:42.635832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:42.637255 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-21b606f6-0c76-4991-bc3e-33c40ee1f96f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.162747 Jul 28 10:39:42.638370 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 287/551] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:42 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:42.807311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:42.808535 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:42.816422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:42.816944 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:42.818403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:42.819082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:42.955505 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:42.965974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ac5b95e3-33e3-4ebc-bc88-840eff30fef7 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1513 microversion: 2.1 time: 0.162849 Jul 28 10:39:42.979538 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 265/552] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:42 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:43.230864 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:43.231635 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:43.242857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:43.244571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:43.245475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:43.245978 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:43.452285 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:43.463377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9f101e62-02a4-4494-a02c-abe3edd526b8 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.236554 Jul 28 10:39:43.465382 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 288/553] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:43 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:43.586119 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-3f35e6b5-68d2-4d58-9a22-bfa230a9ba45 req-f452c856-290d-45bb-963a-a6185eb8356d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac711f2-4c32-4273-baa3-89d7f6fa16b9", "name": "network-vif-deleted", "tag": "cd19cc6a-e63e-4e60-8c1c-07e4a5d3f83e"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:43.587318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:43.587318 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:43.598310 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-3f35e6b5-68d2-4d58-9a22-bfa230a9ba45 req-f452c856-290d-45bb-963a-a6185eb8356d service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:43.599284 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-3f35e6b5-68d2-4d58-9a22-bfa230a9ba45 req-f452c856-290d-45bb-963a-a6185eb8356d service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:43.623630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-3f35e6b5-68d2-4d58-9a22-bfa230a9ba45 req-f452c856-290d-45bb-963a-a6185eb8356d service nova] Creating event network-vif-deleted:cd19cc6a-e63e-4e60-8c1c-07e4a5d3f83e for instance fac711f2-4c32-4273-baa3-89d7f6fa16b9 on hv-cinder-80043 Jul 28 10:39:43.633406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-3f35e6b5-68d2-4d58-9a22-bfa230a9ba45 req-f452c856-290d-45bb-963a-a6185eb8356d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051172 Jul 28 10:39:43.634005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 266/554] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:43.657229 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:43.658523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:43.665282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:43.666029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:43.667005 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:43.667661 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:43.840729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:43.849843 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:43.851291 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:43.852426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9ed11cc7-73ba-4dfd-bc37-4321a7711e35 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.200228 Jul 28 10:39:43.853091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 289/555] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:43 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:43.985711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:43.986324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:43.993145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:43.999816 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:44.000804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:44.001439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:44.037168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:44.037168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:44.037519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lazy-loading 'fault' on Instance uuid fac711f2-4c32-4273-baa3-89d7f6fa16b9 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:39:44.085947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:44.094642 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f46afd62-ae7f-45bd-bbf1-66cfbbcd7b1c tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 200 len: 1308 microversion: 2.1 time: 0.112881 Jul 28 10:39:44.104256 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 267/556] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:43 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:44.481299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:44.482268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:44.494034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:44.494476 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:44.495252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:44.495680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:44.650813 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:44.659070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b6d01447-7409-4470-a4e8-830abab58fa5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.181852 Jul 28 10:39:44.659775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 290/557] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:44 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:44.871666 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:44.872184 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:44.879632 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:44.880395 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:44.881201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:44.881618 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.028520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:45.039880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:45.042660 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:45.043817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d4be174e-c1b4-47de-9710-4ae8ab3286ab tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.175949 Jul 28 10:39:45.044367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 268/558] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:44 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:45.111386 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:45.112117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: fac711f2-4c32-4273-baa3-89d7f6fa16b9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:45.119660 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.120213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.121161 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.121546 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.139023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] HTTP exception thrown: Instance fac711f2-4c32-4273-baa3-89d7f6fa16b9 could not be found. Jul 28 10:39:45.139532 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Returning 404 to user: Instance fac711f2-4c32-4273-baa3-89d7f6fa16b9 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:39:45.140378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ba86106f-20b9-4a67-81ac-dee808db3725 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9" status: 404 len: 111 microversion: 2.1 time: 0.032807 Jul 28 10:39:45.140991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 291/559] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:45 2021] GET /compute/v2.1/servers/fac711f2-4c32-4273-baa3-89d7f6fa16b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:45.150274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:45.150770 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:45.157328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.157776 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.158566 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.158996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.188991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:39:45.290990 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ba53d53a-f086-4544-8135-6965b3d385d2 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 204 len: 0 microversion: 2.1 time: 0.145411 Jul 28 10:39:45.292001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 269/560] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:39:45 2021] DELETE /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:45.299268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:45.299883 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:45.309821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.310565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.311526 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.312187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.457804 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:45.465784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-be2b058f-8c0b-496c-aa1d-266e7c5a7b13 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1513 microversion: 2.1 time: 0.170005 Jul 28 10:39:45.466349 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 292/561] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:45 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:45.675902 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:45.676727 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:45.688223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.689045 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.691009 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:45.691681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:45.822724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:45.831155 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-75167891-376c-4edd-b814-2015a7fd4bd1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.159276 Jul 28 10:39:45.831739 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 270/562] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:45 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:46.061434 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:46.062086 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:46.068014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:46.068455 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:46.069248 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:46.069684 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:46.187155 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:46.195022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:46.196514 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:46.197673 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-11b10297-77fd-478d-a5c5-0cf8f7fa2f4c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1741 microversion: 2.20 time: 0.139880 Jul 28 10:39:46.198225 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 293/563] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:46 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1741 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:46.483020 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:46.483560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:46.489512 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:46.489974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:46.490737 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:46.491176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:46.614554 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:46.622014 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2610e3d6-07c1-4b7f-b011-1b1eb6f1a183 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1513 microversion: 2.1 time: 0.142783 Jul 28 10:39:46.622843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 271/564] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:46 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:46.847289 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:46.848008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:46.854186 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:46.854622 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:46.855376 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:46.855869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:47.023480 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:47.031269 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e8783f67-9916-4ea7-8f9f-3cd30bbe1b7c tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.187711 Jul 28 10:39:47.031838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 294/565] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:46 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:47.215202 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:47.215807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:47.221638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:47.222102 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:47.222848 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:47.223280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:47.350278 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:47.358328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:47.359798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:47.360968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cd2d6528-b42e-4f7c-91ec-2555c488da18 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1723 microversion: 2.20 time: 0.149445 Jul 28 10:39:47.361532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 272/566] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:47 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:47.640377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:47.641020 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:47.649732 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:47.650478 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:47.651780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:47.652496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:47.915465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:47.923000 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2adcb25b-0543-48bc-9204-7fc0e7ab5090 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 200 len: 1513 microversion: 2.1 time: 0.287359 Jul 28 10:39:47.923802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 295/567] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:47 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:48.050968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:48.051602 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:48.058385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.058893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.059620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.060123 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.135017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-2e422a25-faf9-4af9-9b2c-4a1e9b10cbbc req-2b8e4db1-1b63-4e90-9c3f-7c28e4a57b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada72fe7-516f-4e03-92b1-c5112f8ca0d9", "name": "network-vif-deleted", "tag": "7ead3efc-6e34-4e14-a0fb-2e8dcbf09a18"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:48.137704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:48.137704 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:39:48.146169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-2e422a25-faf9-4af9-9b2c-4a1e9b10cbbc req-2b8e4db1-1b63-4e90-9c3f-7c28e4a57b59 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.146628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-2e422a25-faf9-4af9-9b2c-4a1e9b10cbbc req-2b8e4db1-1b63-4e90-9c3f-7c28e4a57b59 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.159854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-2e422a25-faf9-4af9-9b2c-4a1e9b10cbbc req-2b8e4db1-1b63-4e90-9c3f-7c28e4a57b59 service nova] Creating event network-vif-deleted:7ead3efc-6e34-4e14-a0fb-2e8dcbf09a18 for instance ada72fe7-516f-4e03-92b1-c5112f8ca0d9 on hv-cinder-80043 Jul 28 10:39:48.170195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-2e422a25-faf9-4af9-9b2c-4a1e9b10cbbc req-2b8e4db1-1b63-4e90-9c3f-7c28e4a57b59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038960 Jul 28 10:39:48.171202 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 296/568] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:48.203605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:48.212240 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2dbd61c6-d257-4f72-8bed-b609d270ba80 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.164953 Jul 28 10:39:48.213087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 273/569] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:48 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:48.379647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:48.381029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:48.387126 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.387577 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.388395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.388806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.507869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:48.515657 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:48.517185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:48.518305 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9ab2b784-857f-42f7-aff0-0ec3fc2e81dc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1723 microversion: 2.20 time: 0.142736 Jul 28 10:39:48.518858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 297/570] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:48 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:48.943468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:48.943995 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: ada72fe7-516f-4e03-92b1-c5112f8ca0d9] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:48.949819 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.950267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.951028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:48.951465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:48.965453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] HTTP exception thrown: Instance ada72fe7-516f-4e03-92b1-c5112f8ca0d9 could not be found. Jul 28 10:39:48.966069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Returning 404 to user: Instance ada72fe7-516f-4e03-92b1-c5112f8ca0d9 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:39:48.966881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6e587c64-89ea-4ce2-a2b5-02d139a6b1ff tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9" status: 404 len: 111 microversion: 2.1 time: 0.027483 Jul 28 10:39:48.967403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 274/571] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:48 2021] GET /compute/v2.1/servers/ada72fe7-516f-4e03-92b1-c5112f8ca0d9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:49.229968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:49.230478 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:49.236166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:49.236605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:49.237402 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:49.237832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:49.359303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.367200 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ee345f45-77bd-4a3f-9724-06f8857c065d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.141075 Jul 28 10:39:49.367773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 298/572] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:49 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:49.536526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:49.537177 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:49.543436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:49.543881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:49.544638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:49.545106 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:49.667033 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.675666 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.677187 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:49.679191 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0be055cf-4255-489c-9568-a491681c33a6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1723 microversion: 2.20 time: 0.146332 Jul 28 10:39:49.679744 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 275/573] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:49 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:50.095615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:50.096319 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:50.103282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.103728 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.104490 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.104950 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.131638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:39:50.211340 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-137ba4f5-13b0-48d8-8083-bd576948a603 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 204 len: 0 microversion: 2.1 time: 0.119657 Jul 28 10:39:50.212285 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 299/574] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:39:50 2021] DELETE /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:50.220268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:50.220920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:50.227485 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.227937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.228722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.229179 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.349942 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:50.357275 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dc5a881d-64ed-46b3-809d-673046500b31 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1512 microversion: 2.1 time: 0.140706 Jul 28 10:39:50.357840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 276/575] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:50 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:50.384084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:50.384819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:50.390606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.391052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.391826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.392257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.510095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:50.517775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-092a6c7b-ec42-4532-a175-233771dec09e tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.138084 Jul 28 10:39:50.518341 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 300/576] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:50 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:50.697237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:50.697903 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:50.703842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.704289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.705085 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.705523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.823783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:50.831453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:50.832990 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:50.834806 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6d37671d-dd88-402f-9ba6-e37ffc9823a5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1666 microversion: 2.20 time: 0.141300 Jul 28 10:39:50.835365 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 277/577] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:50 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1666 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:50.852241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed1d735d-4443-488e-8492-f2e282521533"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:50.853366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:50.859133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.859579 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:50.860333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:50.860791 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.119367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6bce9944-c734-4c86-a98a-71003c03e663 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.270993 Jul 28 10:39:51.119961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 301/578] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Jul 28 10:39:50 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-volume_attachments => generated 188 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:39:51.183331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:51.183892 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:51.189627 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.190071 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.190821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.191252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.267540 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2370c6ae-15a0-4ca3-b226-a384c4df0f28 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action" status: 202 len: 0 microversion: 2.20 time: 0.087789 Jul 28 10:39:51.268129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 278/579] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:39:51 2021] POST /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:39:51.276150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:51.276768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:51.283470 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.284017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.284891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.285391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.375167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:51.375989 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:51.383234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.383698 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.384479 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.384961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.407729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:51.416798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:51.418712 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:51.420277 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a99398e6-a5c8-4f76-b553-da3448ee1de6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1752 microversion: 2.20 time: 0.147915 Jul 28 10:39:51.421164 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 302/580] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:51 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:51.509381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:51.516715 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-05b2f563-3d81-4190-8998-448f5304088d tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1512 microversion: 2.1 time: 0.145376 Jul 28 10:39:51.517319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 279/581] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:51 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:51.534404 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:51.535011 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:51.541434 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.541882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.542643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.543075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.669713 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:51.678131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5024bca3-4b9c-423d-9f4f-dbb426323b54 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.146769 Jul 28 10:39:51.678698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 303/582] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:51 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:51.960415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-e0e6f29e-fc9a-40e6-a36f-4656b26fd08f req-21826dcf-0c27-44ac-957e-9b688cfc4e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "name": "network-vif-unplugged", "status": "completed", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:51.962227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:51.962227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:51.971230 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-e0e6f29e-fc9a-40e6-a36f-4656b26fd08f req-21826dcf-0c27-44ac-957e-9b688cfc4e7e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:51.971844 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-e0e6f29e-fc9a-40e6-a36f-4656b26fd08f req-21826dcf-0c27-44ac-957e-9b688cfc4e7e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:51.984293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.compute.server_external_events [req-e0e6f29e-fc9a-40e6-a36f-4656b26fd08f req-21826dcf-0c27-44ac-957e-9b688cfc4e7e service nova] Unable to find a host for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b. Dropping event network-vif-unplugged {{(pid=119121) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 28 10:39:51.985449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-e0e6f29e-fc9a-40e6-a36f-4656b26fd08f req-21826dcf-0c27-44ac-957e-9b688cfc4e7e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029909 Jul 28 10:39:51.986120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 280/583] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 10:39:52.439195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:52.439810 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:52.446698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:52.447144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:52.448053 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:52.448495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:52.533334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:52.533884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:52.540224 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:52.540672 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:52.541462 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:52.541890 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:52.640014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.649209 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.650686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.651814 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2d6f6167-f119-4230-8b8b-3a1eb294746b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1754 microversion: 2.20 time: 0.216349 Jul 28 10:39:52.652362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 304/584] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:52 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:52.667090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.675680 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c5bcb2ba-e993-4cee-8cfa-dea479f27c4b tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1512 microversion: 2.1 time: 0.145947 Jul 28 10:39:52.676272 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 281/585] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:52 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:39:52.696372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:52.697114 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:52.703225 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:52.703664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:52.704494 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:52.705034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:52.892886 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:52.901852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9647c6ab-a951-47da-a566-2515e64435c4 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.210328 Jul 28 10:39:52.902434 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 305/586] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:52 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:53.035572 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-9efb6ba8-854c-402c-bd06-87f97ab58e9a req-9f4bcea3-e350-431f-b3b8-6ad8edaccf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3db5de-a472-45e5-a610-d9bdd36b7bd3", "name": "network-vif-deleted", "tag": "6f57a2ab-148f-4e21-aeaf-c45183c305ef"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:39:53.037628 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:39:53.037628 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:39:53.047634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-9efb6ba8-854c-402c-bd06-87f97ab58e9a req-9f4bcea3-e350-431f-b3b8-6ad8edaccf1a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.048294 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-9efb6ba8-854c-402c-bd06-87f97ab58e9a req-9f4bcea3-e350-431f-b3b8-6ad8edaccf1a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.061111 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-9efb6ba8-854c-402c-bd06-87f97ab58e9a req-9f4bcea3-e350-431f-b3b8-6ad8edaccf1a service nova] Creating event network-vif-deleted:6f57a2ab-148f-4e21-aeaf-c45183c305ef for instance 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 on hv-cinder-80043 Jul 28 10:39:53.067261 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-9efb6ba8-854c-402c-bd06-87f97ab58e9a req-9f4bcea3-e350-431f-b3b8-6ad8edaccf1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036153 Jul 28 10:39:53.068947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 282/587] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:39:53.693822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:53.694437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:53.700500 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.700975 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.701745 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.702175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.710575 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:53.711280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:53.717326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.717774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.718554 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.718995 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.734496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.734866 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.735313 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lazy-loading 'fault' on Instance uuid 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:39:53.822913 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39dc329d6654473e869f8892dbb3e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306fbc7a4d5e433d938a4bae2209a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:53.830744 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d4874aab-15e2-499e-b30e-2e4d1c024472 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 200 len: 1307 microversion: 2.1 time: 0.141073 Jul 28 10:39:53.831766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 306/588] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:53 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 1307 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:53.844012 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:53.852555 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:53.854140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:53.855281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d4faac72-437f-4be5-a34a-1ab06b137f56 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.149585 Jul 28 10:39:53.855833 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 283/589] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:53 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:53.918997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:53.919515 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:53.925339 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.925779 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:53.926536 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:53.927025 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:54.137278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:54.145521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ceaedd9e-fd14-47f2-9ca0-d5c3f40e4b11 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.230184 Jul 28 10:39:54.146960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 307/590] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:53 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:54.848131 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:54.848674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] [instance: 1e3db5de-a472-45e5-a610-d9bdd36b7bd3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:54.855406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:54.855852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:54.856616 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:54.857082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:54.871297 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] HTTP exception thrown: Instance 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 could not be found. Jul 28 10:39:54.871897 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] Returning 404 to user: Instance 1e3db5de-a472-45e5-a610-d9bdd36b7bd3 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:39:54.873005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f9aa78b3-aaf9-450f-b076-a8f37d951c33 tempest-AttachVolumeNegativeTest-679413523 tempest-AttachVolumeNegativeTest-679413523-project] 10.222.0.25 "GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3" status: 404 len: 111 microversion: 2.1 time: 0.028544 Jul 28 10:39:54.874232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:54.874801 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 284/591] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:54 2021] GET /compute/v2.1/servers/1e3db5de-a472-45e5-a610-d9bdd36b7bd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:39:54.874905 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:54.881166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:54.881698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:54.882605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:54.883047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:55.095922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:55.104475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:55.105991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:55.107312 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b9ee7699-a6bd-4459-9275-8e8dc9c4478f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.237223 Jul 28 10:39:55.107827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 308/592] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:54 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:39:55.163378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:55.165252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:55.173651 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:55.173957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:55.174827 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:55.175486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:55.672221 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:55.680402 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dbdecb37-01ff-4138-8681-bc0d266d68c1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.520952 Jul 28 10:39:55.681062 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 285/593] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:55 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:56.126831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:56.127416 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:56.135838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:56.136522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:56.140094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:56.143137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:56.295115 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:56.306390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:56.308789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:56.310506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0097682c-9e3b-46d1-a850-4d8be70c6748 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.187961 Jul 28 10:39:56.311210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 309/594] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:56 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:56.698520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:56.701040 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:56.709418 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:56.709968 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:56.711313 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:56.711313 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:56.869373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:56.878118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6399e709-2a37-4424-b07c-455752f0e516 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.184059 Jul 28 10:39:56.878773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 286/595] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:56 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:57.329705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:57.330324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:57.336834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:57.337286 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:57.338231 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:57.338670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:57.466293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:57.475055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:57.476850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:57.478027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-baf3b51c-39d0-4e77-ba90-206620e9bfd9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.152279 Jul 28 10:39:57.478965 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 310/596] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:57 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:57.895560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:57.897531 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:57.905682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:57.906642 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:57.907713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:57.908464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:58.056502 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:58.064379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-22e9fe7c-c679-46f7-8f6a-6b9862402dd5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.172993 Jul 28 10:39:58.064984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 287/597] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:57 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:58.496935 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:58.498938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:58.505872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:58.506665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:58.507656 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:58.508598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:58.639574 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:58.648931 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:58.650481 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:58.651853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c5d6717c-d560-4ab2-ac1d-760f0638ed13 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.158757 Jul 28 10:39:58.652580 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 311/598] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:58 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:39:59.081861 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:59.082466 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:59.089871 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:59.090549 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:59.091776 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:59.092861 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:59.224296 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:59.232368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fc6ea396-e221-42ef-a1ad-304dd16a4142 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.154154 Jul 28 10:39:59.232974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 288/599] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:39:59 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:39:59.674348 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:39:59.676169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:39:59.683204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:59.685398 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:59.686360 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:39:59.686871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:39:59.815474 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:59.824473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:59.826170 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:39:59.827311 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-85bb32f4-a76e-478f-8e35-30185943ac80 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.157194 Jul 28 10:39:59.827913 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 312/600] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:39:59 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:00.250580 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:00.252158 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:00.259618 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:00.260067 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:00.260891 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:00.261328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:00.384438 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:00.393754 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b3ebf680-e1a1-45b0-9d6d-aad5aea8f760 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.147220 Jul 28 10:40:00.400668 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 289/601] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:00 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:00.845551 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:00.846185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:00.854176 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:00.854753 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:00.855643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:00.856182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:00.980808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:00.989070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:00.990614 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:00.991767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f8899eed-95a2-46ba-acf5-c2eb553dd20d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.149929 Jul 28 10:40:00.992321 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 313/602] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:00 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:01.410630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:01.411255 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:01.417329 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:01.417783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:01.418555 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:01.418997 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:01.544002 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:01.551864 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5b7320dd-f53e-41ec-b08f-a6da48b793b2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.144982 Jul 28 10:40:01.552485 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 290/603] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:01 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:02.010479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:02.011076 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:02.016996 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:02.017443 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:02.018232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:02.018665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:02.152538 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:02.161271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:02.163639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:02.164795 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2c6b1fbf-7019-435b-9bde-20575d70a61d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.158000 Jul 28 10:40:02.165357 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 314/604] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:02 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:40:02.569151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:02.569902 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:02.576122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:02.576577 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:02.577465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:02.577908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:02.706629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:02.715348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-74631a6a-3dac-437a-9964-dea7c86d7d20 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.150893 Jul 28 10:40:02.715924 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 291/605] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:02 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:03.186064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:03.187007 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:03.193628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:03.194206 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:03.195863 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:03.196371 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:03.317760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:03.328069 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:03.329591 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:03.330725 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9156ab41-5ee3-4857-a257-427973ba0b44 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.150288 Jul 28 10:40:03.331573 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 315/606] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:03 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:03.733388 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:03.734013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:03.740478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:03.740965 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:03.742319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:03.742749 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:03.868325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:03.876738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8ec1c9a4-2293-446b-bd82-35decb24b70f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.147294 Jul 28 10:40:03.877362 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 292/607] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:03 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:04.348977 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:04.349663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:04.355601 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:04.356050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:04.356842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:04.357277 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:04.483121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:04.491850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:04.493908 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:04.495147 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9b1f52eb-623a-439b-8ec0-df5b58afa381 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.149775 Jul 28 10:40:04.495850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 316/608] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:04 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:04.900271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:04.901055 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:04.907534 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:04.907981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:04.909047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:04.909487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:05.057967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:05.065789 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8068a7b7-63a5-4c3a-90c7-83e19cd0d6b6 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.170557 Jul 28 10:40:05.066355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 293/609] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:04 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:05.514070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:05.514679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:05.520496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:05.521047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:05.521816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:05.522298 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:05.649617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:05.658629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:05.660072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:05.661257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bbcacf37-1250-45f8-a354-59418e705c76 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.150940 Jul 28 10:40:05.661846 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 317/610] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:05 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:06.084763 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:06.086157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:06.092052 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:06.092501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:06.093371 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:06.093806 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:06.221576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:06.230757 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3486e0c0-f09c-4e3a-8777-57d6b42eb641 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.150482 Jul 28 10:40:06.231527 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 294/611] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:06 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:06.680771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:06.681380 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:06.687302 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:06.687961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:06.689019 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:06.689521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:06.815104 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:06.823500 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:06.825039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:06.826246 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bc5152cc-a6df-4e28-bc8c-5e764a5c60e0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.149911 Jul 28 10:40:06.826814 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 318/612] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:06 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:07.247071 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:07.247975 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:07.253796 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:07.254239 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:07.254994 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:07.255426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:07.373706 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:07.381316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8a8f1a87-19ce-4b28-932a-83a7abe4ebfb tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.137935 Jul 28 10:40:07.382411 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 295/613] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:07 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:07.844258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:07.845015 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:07.851046 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:07.851607 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:07.852603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:07.853136 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:07.989453 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:07.998894 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:08.000403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:08.001632 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2b49b0b7-3248-4056-9ed8-2ebaf84ddb26 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.161129 Jul 28 10:40:08.002188 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 319/614] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:07 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:08.398923 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:08.399707 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:08.405684 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:08.406128 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:08.406887 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:08.407316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:08.531120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:08.539943 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-48ab6975-3a18-4625-b27a-e8b514c7b5e5 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.145157 Jul 28 10:40:08.540520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 296/615] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:08 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:09.019927 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:09.020442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:09.026968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:09.027407 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:09.028238 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:09.028664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:09.154248 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:09.163421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:09.164985 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:09.166198 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0a03b268-2a06-4477-8d02-bbe096c17280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.150010 Jul 28 10:40:09.166841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 320/616] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:09 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:09.557607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:09.558256 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:09.564229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:09.564691 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:09.565470 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:09.565901 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:09.691988 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:09.700905 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d6cbb2bd-8093-4431-b9d5-c0ad1f3325b3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1568 microversion: 2.1 time: 0.148031 Jul 28 10:40:09.701919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 297/617] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:09 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:10.185185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:10.185850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:10.191734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.192175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.192970 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.193401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.313903 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:10.323155 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:10.324638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:10.325805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-43d1c8b1-c91d-43af-974b-f655964a1549 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.144437 Jul 28 10:40:10.326502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 321/618] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:10 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:10.717969 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:10.718605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:10.724424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.724917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.726329 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.726769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.845938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:10.854464 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e0e6edb9-ddf7-43fa-89d5-a89e3b97e418 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1548 microversion: 2.1 time: 0.140256 Jul 28 10:40:10.855025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 298/619] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:10 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1548 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:10.870392 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:10.870893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:10.876919 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.877368 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.878133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.878570 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.961339 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] HTTP exception thrown: Cannot 'detach_volume' instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 while it is in vm_state rescued Jul 28 10:40:10.962128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Returning 409 to user: Cannot 'detach_volume' instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 while it is in vm_state rescued {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:40:10.962923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1c62db71-62a5-4ccb-9a36-09ee6ceef6d9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments/0a24ebc5-333f-41e5-8689-342dc8db1b55" status: 409 len: 152 microversion: 2.1 time: 0.096317 Jul 28 10:40:10.963467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 322/620] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:40:10 2021] DELETE /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments/0a24ebc5-333f-41e5-8689-342dc8db1b55 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 10:40:10.971675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:10.972210 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:10.978663 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.979116 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:10.979884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:10.980328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:11.044886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-970d0335-4be5-44cd-bcbe-e48c3c583c84 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action" status: 202 len: 0 microversion: 2.1 time: 0.076610 Jul 28 10:40:11.045537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 299/621] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:40:10 2021] POST /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:11.053463 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:11.054217 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:11.060280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:11.060739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:11.061545 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:11.061981 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:11.263149 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:11.270973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b91ac518-31bf-4a64-ae67-4bafdd47e5ea tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1556 microversion: 2.1 time: 0.221173 Jul 28 10:40:11.271568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 323/622] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:11 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1556 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:11.345260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:11.346089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:11.352905 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:11.353361 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:11.354138 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:11.354609 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:11.480141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:11.489623 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:11.492081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:11.493266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f39af47e-0431-4006-a670-2b44736a5331 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.152251 Jul 28 10:40:11.497503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 300/623] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:11 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:12.290011 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:12.290541 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:12.296300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:12.296767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:12.297546 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:12.297985 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:12.417043 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:12.424829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-beac77e1-2dc4-48a0-bede-c490a3bf60a3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1556 microversion: 2.1 time: 0.139293 Jul 28 10:40:12.425395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 324/624] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:12 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1556 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:12.511624 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:12.512227 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:12.518046 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:12.518511 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:12.519266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:12.519728 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:12.639462 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:12.648562 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:12.650101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:12.651223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d81331eb-d9e2-47b3-a99b-18935ca2eb1b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.143353 Jul 28 10:40:12.651780 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 301/625] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:12 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:13.442540 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:13.443255 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:13.449599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:13.450039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:13.450792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:13.451219 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:13.572840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:13.580618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e586ef64-df80-415e-8a24-421857e782f3 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1556 microversion: 2.1 time: 0.141753 Jul 28 10:40:13.581243 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 325/626] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:13 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1556 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:13.668717 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:13.669340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:13.675077 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:13.675521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:13.676270 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:13.676701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:13.794667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:13.802815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:13.804946 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:13.806102 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5436dacd-7d85-434e-89a9-b2a7b899c513 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.141067 Jul 28 10:40:13.806656 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 302/627] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:13 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:14.597657 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:14.598267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:14.604726 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:14.605198 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:14.605962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:14.606392 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:14.729324 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:14.737091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-85a40b99-a813-4da2-99bd-db3026de4a3d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1562 microversion: 2.1 time: 0.143021 Jul 28 10:40:14.737659 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 326/628] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:14 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:14.808228 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:14.808830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:14.814656 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:14.815108 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:14.815905 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:14.816346 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:14.824620 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:14.825259 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:14.830995 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:14.831437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:14.832201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:14.832664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:14.901445 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lazy-loading 'services' on Instance uuid a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:40:14.961031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:14.970895 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:14.971657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-49cd1cd2-f3d8-437b-bc0f-820c39863091 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments/0a24ebc5-333f-41e5-8689-342dc8db1b55" status: 202 len: 0 microversion: 2.1 time: 0.167064 Jul 28 10:40:14.972245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 303/629] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:40:14 2021] DELETE /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3/os-volume_attachments/0a24ebc5-333f-41e5-8689-342dc8db1b55 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:14.976085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:14.976085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-11ce210f-16c4-4e8d-b915-d2736c09442f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.153479 Jul 28 10:40:14.976085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 327/630] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:14 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:40:15.993873 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:15.994619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:16.000862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:16.001305 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:16.002062 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:16.002492 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:16.133093 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:16.141981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:16.143445 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:16.144597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5b354e59-fd40-4a41-92da-04eaf990d1d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.155288 Jul 28 10:40:16.145409 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 304/631] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:15 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:17.162773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:17.163386 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:17.169249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:17.169698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:17.170466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:17.170901 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:17.298055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.307663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.309523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:17.310724 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-aca4b3d5-f8a2-4b18-b1d4-dc6487b61520 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.151604 Jul 28 10:40:17.311435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 328/632] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:17 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:18.136209 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-601fe8c5-c887-4da8-abb7-a6cefc6ffa5c req-9e6d8b9f-bf00-483d-af47-77e805b05dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "name": "network-vif-plugged", "status": "completed", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:18.137826 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:40:18.137826 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:40:18.145309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-601fe8c5-c887-4da8-abb7-a6cefc6ffa5c req-9e6d8b9f-bf00-483d-af47-77e805b05dfb service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.145683 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-601fe8c5-c887-4da8-abb7-a6cefc6ffa5c req-9e6d8b9f-bf00-483d-af47-77e805b05dfb service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.159204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-601fe8c5-c887-4da8-abb7-a6cefc6ffa5c req-9e6d8b9f-bf00-483d-af47-77e805b05dfb service nova] Creating event network-vif-plugged:602fc625-de40-4d7c-8ac1-0c239e6258a7 for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b on hv-cinder-80043 Jul 28 10:40:18.165610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-601fe8c5-c887-4da8-abb7-a6cefc6ffa5c req-9e6d8b9f-bf00-483d-af47-77e805b05dfb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Jul 28 10:40:18.166197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 305/633] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:40:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:40:18.329652 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.330292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:18.336619 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.337298 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.338066 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.338496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.378720 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.379398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:18.385706 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.386155 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.386921 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.387367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.412433 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:40:18.462072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.471557 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.473071 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.474296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3edfec63-94d6-49ae-a4b7-f65a2f4d1e5e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.148458 Jul 28 10:40:18.474868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 329/634] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:18 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:18.490648 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-52ea3ec8-2f18-418e-a52e-e218759fff25 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 204 len: 0 microversion: 2.1 time: 0.115569 Jul 28 10:40:18.491300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 306/635] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:40:18 2021] DELETE /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:40:18.499929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:18.500544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:18.506362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.506804 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.507590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:18.508022 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:18.628495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:18.636223 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f3ad1c55-2ee7-4ebc-9e1d-505a93492234 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.140099 Jul 28 10:40:18.637647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 330/636] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:18 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:19.493255 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:19.493851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:19.499862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:19.500317 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:19.501102 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:19.501539 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:19.625182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.634518 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.636009 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.637168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-59442e87-e02e-4ffc-8e45-e5d84b33d2e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.148185 Jul 28 10:40:19.637719 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 307/637] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:19 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:19.654263 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:19.654871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:19.660891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:19.661340 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:19.662103 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:19.662536 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:19.783519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:19.791047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6a5b21fa-1d91-42c1-b49f-0f1c407e03b0 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.140494 Jul 28 10:40:19.791612 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 331/638] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:19 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:20.655089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:20.655702 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:20.661693 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:20.662141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:20.662952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:20.663385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:20.781760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.790027 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.791565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.792735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5e9e26f2-2645-4901-817a-2e660bd48724 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.141296 Jul 28 10:40:20.793328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 308/639] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:20 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:20.807332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:20.807943 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:20.814059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:20.814506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:20.815266 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:20.815699 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:20.934459 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:20.941721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9cc7c43c-9f54-43b1-8844-8918f2f79459 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.138199 Jul 28 10:40:20.942283 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 332/640] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:20 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:21.811536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:21.812139 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:21.818105 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:21.818555 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:21.819312 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:21.819743 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:21.941076 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:21.949634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:21.951116 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:21.952241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-14215f1a-a36b-4de1-b163-75a47327a208 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.144439 Jul 28 10:40:21.952832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 309/641] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:21 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:21.959087 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:21.960011 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:21.968121 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:21.968573 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:21.969387 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:21.969852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:22.088034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:22.095225 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f7f299dc-e419-4b11-bf55-5a1fa701f8ad tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.139878 Jul 28 10:40:22.095792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 333/642] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:21 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:22.534610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:22.535141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:22.540994 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:22.541449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:22.542214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:22.542653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:22.758962 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lazy-loading 'services' on Instance uuid 1075c593-6301-4ed9-b795-78c416194982 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:40:22.822556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8b14846a-fd03-4d5c-ab59-f17bf171a45d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/os-volume_attachments/5b5b1484-e0ea-4468-a993-332dbb4f37cc" status: 202 len: 0 microversion: 2.1 time: 0.291470 Jul 28 10:40:22.823193 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 310/643] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:40:22 2021] DELETE /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/os-volume_attachments/5b5b1484-e0ea-4468-a993-332dbb4f37cc => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:22.971282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:22.971878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:22.978461 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:22.978903 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:22.979944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:22.980378 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:23.100854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:23.109752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:23.111233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:23.112307 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:23.112424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-239f2b34-ba49-4e09-8028-e8d074069afd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.144748 Jul 28 10:40:23.113018 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 334/644] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:22 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:23.113144 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:23.119746 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:23.120196 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:23.120997 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:23.121546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:23.239842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:23.247949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bccb656d-f0ef-4f32-9405-367824cfd149 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.139611 Jul 28 10:40:23.248502 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 311/645] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:23 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:40:24.130791 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:24.131398 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:24.138173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:24.138609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:24.139367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:24.139794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:24.258112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:24.264371 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:24.265046 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:24.266544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:24.268044 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:24.269213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e9b905c2-9f1a-4cd5-aa03-e8c4e868ddf6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.142280 Jul 28 10:40:24.269786 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 335/646] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:24 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:24.271103 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:24.271564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:24.272333 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:24.272793 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:24.396236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:24.404063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-815f4f38-a34c-49c3-b335-a67699d01a72 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.143269 Jul 28 10:40:24.404619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 312/647] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:24 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:40:25.287923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:25.288473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:25.294882 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:25.295321 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:25.296068 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:25.296498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:25.413495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:25.420448 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:25.421090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:25.422422 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:25.423899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:25.425076 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-81d9f7dd-8ab2-450e-87b2-cc10222d79e6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.141676 Jul 28 10:40:25.425628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 336/648] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:25 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:25.426930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:25.427376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:25.428129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:25.428563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:25.549209 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:25.556961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2f9789fe-17ed-4c4a-9f66-6373a507e9a1 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1508 microversion: 2.1 time: 0.140056 Jul 28 10:40:25.557518 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 313/649] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:25 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:26.442968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:26.443587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:26.462956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:26.463400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:26.464208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:26.464645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:26.561708 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-90221617-079e-467b-ba0e-378b99123e8d req-f996288d-6497-4af4-910f-756d77ec3129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd28e13-6930-4641-9020-5257ca4327af", "name": "network-vif-deleted", "tag": "34faabe4-239a-4508-b886-66e6cb2243a3"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:26.563667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:40:26.563667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:40:26.573010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-90221617-079e-467b-ba0e-378b99123e8d req-f996288d-6497-4af4-910f-756d77ec3129 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:26.574138 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-90221617-079e-467b-ba0e-378b99123e8d req-f996288d-6497-4af4-910f-756d77ec3129 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:26.589516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-90221617-079e-467b-ba0e-378b99123e8d req-f996288d-6497-4af4-910f-756d77ec3129 service nova] Creating event network-vif-deleted:34faabe4-239a-4508-b886-66e6cb2243a3 for instance 6cd28e13-6930-4641-9020-5257ca4327af on hv-cinder-80043 Jul 28 10:40:26.595040 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-90221617-079e-467b-ba0e-378b99123e8d req-f996288d-6497-4af4-910f-756d77ec3129 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037574 Jul 28 10:40:26.595979 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 314/650] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:40:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:40:26.602270 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:26.602982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:26.610090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:26.610593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:26.611713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:26.612153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:26.653140 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:26.662858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:26.667027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:26.667027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-66a350bc-6804-462a-9fef-05388af3e389 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1810 microversion: 2.20 time: 0.227598 Jul 28 10:40:26.667766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 337/651] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:26 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:26.683261 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:26.690823 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-97f56db4-c837-4ba9-8df2-0cb67e90e8c2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1466 microversion: 2.1 time: 0.093454 Jul 28 10:40:26.692019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 315/652] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:26 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1466 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:27.110292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-22c1dab1-8ab9-4604-a716-9aa99def3c5a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:27.116051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-22c1dab1-8ab9-4604-a716-9aa99def3c5a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.116515 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-22c1dab1-8ab9-4604-a716-9aa99def3c5a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.138786 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-22c1dab1-8ab9-4604-a716-9aa99def3c5a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Going to try to stop instance {{(pid=119120) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 28 10:40:27.182249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-22c1dab1-8ab9-4604-a716-9aa99def3c5a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 202 len: 0 microversion: 2.1 time: 0.075458 Jul 28 10:40:27.182761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 338/653] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:40:27 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:27.191401 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:27.192089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:27.198935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.199417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.200143 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.200588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.323410 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:27.331388 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-877a18bb-60a8-4fa6-a300-d09e4474fe55 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.143645 Jul 28 10:40:27.331949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 316/654] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:27 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:27.686598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:27.687561 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:27.694571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.695475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.696537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.696994 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.709138 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:27.711246 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:27.718423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.718952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.719799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.720369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.752883 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:27.753449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:27.753971 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lazy-loading 'fault' on Instance uuid 6cd28e13-6930-4641-9020-5257ca4327af {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:40:27.798317 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:27.805198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-67db7e4a-1fca-432f-ace3-cde6831cc795 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 200 len: 1312 microversion: 2.1 time: 0.100113 Jul 28 10:40:27.805846 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 317/655] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:27 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:27.825208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:27.833578 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:27.835064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:27.837004 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7ed8902d-0c18-48ee-8b61-31a30e2df388 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1797 microversion: 2.20 time: 0.155026 Jul 28 10:40:27.837556 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 339/656] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:40:27 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1797 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:40:28.348239 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:28.348941 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:28.355618 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.356068 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.356865 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.357304 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.478044 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:28.485232 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-72a8a074-40d4-4f6a-8cfc-650133281c16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.140681 Jul 28 10:40:28.485799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 318/657] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:28 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:28.822766 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:28.823389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: 6cd28e13-6930-4641-9020-5257ca4327af] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:28.830138 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.830606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.831471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.831910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.845759 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] HTTP exception thrown: Instance 6cd28e13-6930-4641-9020-5257ca4327af could not be found. Jul 28 10:40:28.846526 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Returning 404 to user: Instance 6cd28e13-6930-4641-9020-5257ca4327af could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:40:28.847581 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cc090c10-c7cf-4da7-9c43-e66720c53ac9 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af" status: 404 len: 111 microversion: 2.1 time: 0.029248 Jul 28 10:40:28.848183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 340/658] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:28 2021] GET /compute/v2.1/servers/6cd28e13-6930-4641-9020-5257ca4327af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:28.857510 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:28.858162 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:28.863989 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.864432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.865217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.865649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.892561 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:40:28.966605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bf3ae0dd-a03f-436a-8d24-9752d788af6a tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 204 len: 0 microversion: 2.1 time: 0.112773 Jul 28 10:40:28.967218 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 319/659] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:40:28 2021] DELETE /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:40:28.976157 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:28.976917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:28.983239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.983690 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:28.984451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:28.984948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:29.104326 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:29.111519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-dfa4a7a1-8f08-4ff5-8f14-f942e679f19d tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.140177 Jul 28 10:40:29.112071 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 341/660] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:28 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:29.502904 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:29.503529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:29.509287 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:29.509729 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:29.510494 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:29.510928 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:29.631134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:29.638583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-06031d53-4df1-4bfb-80b6-963eeb0d79d7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.139852 Jul 28 10:40:29.639148 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 320/661] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:29 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:30.129670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:30.130261 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:30.136196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:30.136631 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:30.137419 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:30.137849 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:30.254599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:30.262062 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-966086db-e2dd-4116-9b89-7fd45a98cd70 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.136013 Jul 28 10:40:30.262623 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 342/662] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:30 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:30.656285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:30.657010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:30.662885 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:30.663340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:30.664114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:30.664555 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:30.793139 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:30.801087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3e91dd62-deab-412c-9b47-880cba85c2aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.148670 Jul 28 10:40:30.804785 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 321/663] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:30 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:31.278540 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:31.279152 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:31.284906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:31.285359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:31.286122 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:31.286569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:31.403715 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:31.410972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6d1a3bc2-91cd-443d-b4eb-354524a43505 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.136259 Jul 28 10:40:31.411533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 343/664] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:31 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:31.819144 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:31.819756 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:31.825878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:31.826331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:31.827099 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:31.827537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:31.953180 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:31.960617 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3c6cd0bb-ce80-4555-b151-428b884e2dcf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.145136 Jul 28 10:40:31.961479 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 322/665] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:31 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:32.428420 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.429078 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:32.435633 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:32.436080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:32.436871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:32.437301 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:32.558662 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:32.565893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-eaa01b79-d40f-4eac-96a3-58cbf56f9fde tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.141131 Jul 28 10:40:32.566455 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 344/666] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:32 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:32.979316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:32.979861 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:32.985753 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:32.986197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:32.986953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:32.987386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:33.107080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:33.114416 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dcc0410a-8452-4850-bce7-a021f2857038 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.139483 Jul 28 10:40:33.114974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 323/667] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:32 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:33.582516 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:33.583132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:33.589992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:33.590436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:33.591190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:33.591620 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:33.708461 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:33.716439 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e2777a4c-f544-4096-aac6-4e58317d77f7 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.137643 Jul 28 10:40:33.717034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 345/668] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:33 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:34.130930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:34.131557 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:34.138118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:34.138565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:34.139343 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:34.139771 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:34.255605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:34.262984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-52097e1b-0e2a-459b-81a8-09aa7c7f8d0f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.135670 Jul 28 10:40:34.263552 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 324/669] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:34 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:34.733144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:34.733852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:34.739692 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:34.740129 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:34.740913 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:34.741344 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:34.857914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:34.865349 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-96068016-717f-43bc-848c-5f21e9bf9cd2 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1522 microversion: 2.1 time: 0.135831 Jul 28 10:40:34.865925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 346/670] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:34 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:35.279698 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:35.280316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:35.286171 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:35.286620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:35.287426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:35.287857 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:35.409793 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:35.417406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4caaa371-a69d-4db4-9991-7a2a441ae3db tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.141395 Jul 28 10:40:35.417982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 325/671] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:35 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:35.881972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:35.882593 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:35.888595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:35.889061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:35.889834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:35.890271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:35.969249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6df9a764374ae093f4b8b9c5f9112c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bb4273bddb44d783e4291853ff94bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:35.976792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a0e66c20-3c36-45dd-bbe4-5b9e5ec4549f tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 200 len: 1480 microversion: 2.1 time: 0.098758 Jul 28 10:40:35.978381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 347/672] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:35 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 1480 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:36.015389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-5c1b96a9-65f5-40a4-b84b-2074e4b38115 req-83f423d6-1eaa-47ff-874f-8eec1843fb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3", "name": "network-vif-deleted", "tag": "82804a28-d133-4800-8d06-025b1596883a"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:36.016906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:40:36.016906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:40:36.023853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-5c1b96a9-65f5-40a4-b84b-2074e4b38115 req-83f423d6-1eaa-47ff-874f-8eec1843fb14 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:36.024345 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-5c1b96a9-65f5-40a4-b84b-2074e4b38115 req-83f423d6-1eaa-47ff-874f-8eec1843fb14 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:36.035166 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-5c1b96a9-65f5-40a4-b84b-2074e4b38115 req-83f423d6-1eaa-47ff-874f-8eec1843fb14 service nova] Creating event network-vif-deleted:82804a28-d133-4800-8d06-025b1596883a for instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 on hv-cinder-80043 Jul 28 10:40:36.040794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-5c1b96a9-65f5-40a4-b84b-2074e4b38115 req-83f423d6-1eaa-47ff-874f-8eec1843fb14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028230 Jul 28 10:40:36.041525 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 326/673] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:40:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:40:36.434664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:36.435375 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:36.441682 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:36.442211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:36.443112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:36.443650 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:36.575128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:36.582403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0ee95a22-3e03-4ed3-8d99-3bd2d1372bc5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.151914 Jul 28 10:40:36.582971 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 348/674] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:36 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:36.995103 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:36.995703 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] [instance: a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:37.002100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:37.002546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:37.003309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:37.003742 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:37.017704 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] HTTP exception thrown: Instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 could not be found. Jul 28 10:40:37.018281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] Returning 404 to user: Instance a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:40:37.019086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7c832e06-3ab3-4282-9bd6-50985415bf24 tempest-ServerRescueNegativeTestJSON-1435844511 tempest-ServerRescueNegativeTestJSON-1435844511-project] 10.222.0.25 "GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3" status: 404 len: 111 microversion: 2.1 time: 0.028620 Jul 28 10:40:37.019593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 327/675] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:36 2021] GET /compute/v2.1/servers/a36ceb0e-bf88-4f42-83b3-59dc4e4c5fa3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:40:37.600183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:37.600848 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:37.617719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:37.618231 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:37.619268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:37.619795 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:37.757059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:37.765706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5d5aee50-dc85-4c71-b631-e1987bf447ce tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.169150 Jul 28 10:40:37.768900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 349/676] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:37 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:38.767553 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:40:38.768105 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:40:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:40:38.784445 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:38.785157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:38.793509 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:38.793967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:38.795012 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:38.795990 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:39.031665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:39.043245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-553f01a5-2056-4f9b-9681-5d53152de870 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.261993 Jul 28 10:40:39.057486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 328/677] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:38 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:40.103210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:40.103822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:40.109875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:40.110520 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:40.111591 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:40.112186 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:40.294586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:40.316316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3fbbd19f-fb97-4d82-a9db-79518a86478b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.216672 Jul 28 10:40:40.316949 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 350/678] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:40 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:41.332807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:41.333688 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:41.340639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:41.341153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:41.341941 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:41.342494 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:41.475680 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:41.485539 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4bbbca6f-3d4f-46ef-863c-00c7788d0a56 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.156414 Jul 28 10:40:41.486048 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 329/679] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:41 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:42.503995 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:42.504842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:42.511276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:42.511722 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:42.512487 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:42.512954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:42.650754 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:42.659945 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6f8228db-8241-4cbb-bffe-bfbf489281b1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1679 microversion: 2.1 time: 0.160337 Jul 28 10:40:42.660687 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 351/680] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:42 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:43.679019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:43.679633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:43.691069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:43.691521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:43.692303 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:43.692740 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:43.818601 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:43.826605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-19e76fe0-d274-4e36-a25e-ed1ff5dc0339 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1656 microversion: 2.1 time: 0.151181 Jul 28 10:40:43.827382 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 330/681] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:43 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:43.843790 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ca25a4d5-fa10-4dc2-9c46-68b754c42345 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:40:43.851174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ca25a4d5-fa10-4dc2-9c46-68b754c42345 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:43.851625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ca25a4d5-fa10-4dc2-9c46-68b754c42345 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:43.879989 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ca25a4d5-fa10-4dc2-9c46-68b754c42345 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Going to try to start instance {{(pid=119120) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 28 10:40:43.927993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ca25a4d5-fa10-4dc2-9c46-68b754c42345 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action" status: 202 len: 0 microversion: 2.1 time: 0.087610 Jul 28 10:40:43.928655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 352/682] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:40:43 2021] POST /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:40:43.937899 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:43.938733 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:43.946007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:43.946532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:43.947550 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:43.948424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:44.133602 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:44.141766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-45585862-78cd-4c09-862a-e58409f7fcfb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1665 microversion: 2.1 time: 0.207825 Jul 28 10:40:44.142516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 331/683] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:43 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1665 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:45.160828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:45.161592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:45.168571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:45.169223 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:45.170174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:45.170926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:45.299820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:45.308690 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d3c8a972-e177-4b99-bf9d-70e328bbd263 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1665 microversion: 2.1 time: 0.152726 Jul 28 10:40:45.309125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 353/684] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:45 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:40:46.326431 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:40:46.327078 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:40:46.332953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:46.333403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:46.334173 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:40:46.334607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:40:46.456934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:40:46.464959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8d889889-5b99-4509-9439-8511e8391dba tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1669 microversion: 2.1 time: 0.142076 Jul 28 10:40:46.465526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 332/685] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:40:46 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1669 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:10.932390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:10.932961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:10.938895 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:10.939345 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:10.940137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:10.940567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:10.969234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9ffc0b91-4c96-444a-a1b7-8bc235165f54 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-volume_attachments/ed1d735d-4443-488e-8492-f2e282521533" status: 200 len: 194 microversion: 2.20 time: 0.041191 Jul 28 10:41:10.969954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 354/686] 10.222.0.25 () {60 vars in 1454 bytes} [Wed Jul 28 10:41:10 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-volume_attachments/ed1d735d-4443-488e-8492-f2e282521533 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:41:11.042568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:11.042568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:11.043980 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:11.044420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:11.045200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:11.045634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:11.129360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lazy-loading 'services' on Instance uuid cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:41:11.192821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b077eff1-c409-419e-96aa-cedfc72f6ea0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-volume_attachments/ed1d735d-4443-488e-8492-f2e282521533" status: 202 len: 0 microversion: 2.20 time: 0.159203 Jul 28 10:41:11.193403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 333/687] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Jul 28 10:41:11 2021] DELETE /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b/os-volume_attachments/ed1d735d-4443-488e-8492-f2e282521533 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:41:12.314891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:12.315441 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:12.321246 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:12.322279 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:12.323033 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:12.323467 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:12.347538 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:41:12.421730 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fd624c03-c56d-4716-96b5-da8e2ecf2287 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 204 len: 0 microversion: 2.20 time: 0.110182 Jul 28 10:41:12.422228 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 355/688] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Jul 28 10:41:12 2021] DELETE /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:12.431803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:12.432500 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:12.438576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:12.439026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:12.439804 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:12.440236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:12.565986 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:12.573989 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:12.575497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:12.576639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a9a0c52a-c289-4a5c-9f3e-5d26fc6f35c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.149544 Jul 28 10:41:12.577222 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 334/689] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:12 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:41:13.595391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:13.596096 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:13.601962 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:13.602406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:13.603212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:13.603642 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:13.726587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:13.734992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:13.736484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:13.737646 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c008b7d7-89fe-4113-9c77-6fb9513eec60 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.146367 Jul 28 10:41:13.738206 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 356/690] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:13 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:14.760359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:14.761542 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:14.773189 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:14.775284 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:14.777264 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:14.778054 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:14.921645 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:14.930943 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:14.932678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:14.934080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a3fe52b3-01ed-40e6-8735-89c349685211 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1725 microversion: 2.20 time: 0.181757 Jul 28 10:41:14.934686 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 335/691] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:14 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:15.782857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-b03feaed-82d7-49de-9316-928788984898 req-e57044d5-a3e5-403b-9e84-09937419c343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b", "name": "network-vif-deleted", "tag": "602fc625-de40-4d7c-8ac1-0c239e6258a7"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:15.785568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:15.785568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:41:15.793734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-b03feaed-82d7-49de-9316-928788984898 req-e57044d5-a3e5-403b-9e84-09937419c343 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:15.794186 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-b03feaed-82d7-49de-9316-928788984898 req-e57044d5-a3e5-403b-9e84-09937419c343 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:15.806986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-b03feaed-82d7-49de-9316-928788984898 req-e57044d5-a3e5-403b-9e84-09937419c343 service nova] Creating event network-vif-deleted:602fc625-de40-4d7c-8ac1-0c239e6258a7 for instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b on hv-cinder-80043 Jul 28 10:41:15.813047 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-b03feaed-82d7-49de-9316-928788984898 req-e57044d5-a3e5-403b-9e84-09937419c343 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033549 Jul 28 10:41:15.814029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 357/692] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:15.953181 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:15.954401 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:15.962643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:15.963494 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:15.964906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:15.965607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:16.023472 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:16.025409 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:16.026157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lazy-loading 'fault' on Instance uuid cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:41:16.075498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:16.088919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:16.091181 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:16.092590 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e118ab69-2a5b-4ecd-af77-d41dfb149f0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 200 len: 1372 microversion: 2.20 time: 0.143345 Jul 28 10:41:16.104515 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 336/693] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:15 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:17.111778 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:17.112586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:17.120939 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:17.121649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:17.123802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:17.124288 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:17.142323 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] HTTP exception thrown: Instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b could not be found. Jul 28 10:41:17.142971 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Returning 404 to user: Instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:41:17.143906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-756d7657-84d3-43cc-8af9-93230d984a2c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 404 len: 111 microversion: 2.20 time: 0.036179 Jul 28 10:41:17.144975 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 358/694] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:17 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:41:17.154326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0b76595d-3873-4926-9b41-da2d44813ae5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '.version_select at 0x7fe4777599d0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:17.186955 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0b76595d-3873-4926-9b41-da2d44813ae5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946550612" status: 204 len: 0 microversion: 2.20 time: 0.037366 Jul 28 10:41:17.187782 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 337/695] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Jul 28 10:41:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946550612 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:18.054307 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-42744781-6278-4cab-8305-8f5dd404f21f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'create', calling method: .version_select at 0x7fe4777424c0>, body: {"keypair": {"name": "tempest-keypair-2037778937"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:18.073475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-42744781-6278-4cab-8305-8f5dd404f21f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:41:18.077617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-42744781-6278-4cab-8305-8f5dd404f21f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for user 9de460033b7846bfa2d49e86936e4b68 and project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:41:18.723322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-42744781-6278-4cab-8305-8f5dd404f21f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:41:18.728391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-42744781-6278-4cab-8305-8f5dd404f21f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for user 9de460033b7846bfa2d49e86936e4b68 and project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:41:18.742698 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-42744781-6278-4cab-8305-8f5dd404f21f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.692935 Jul 28 10:41:18.744059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 359/696] 10.222.0.25 () {62 vars in 1199 bytes} [Wed Jul 28 10:41:18 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 695 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:41:20.169271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-283043919", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e98efdf-61ac-4cfd-96bc-8805f92caedb"}], "security_groups": [{"name": "tempest-securitygroup--1736377005"}], "key_name": "tempest-keypair-2037778937", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:20.266271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] validate_networks() for [('2e98efdf-61ac-4cfd-96bc-8805f92caedb', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:41:20.657764 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:41:20.658215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:41:20.658689 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:41:20.659133 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:41:20.659541 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:41:20.669645 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:20.670121 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:20.670920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:20.671439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:20.693406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:41:20.698082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Getting quotas for user 9de460033b7846bfa2d49e86936e4b68 and project f4b9f9b1967a4b24a6ca58290fb2179b. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:41:20.715100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:41:20.717892 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:41:20.769467 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3d8c10bf-2963-4a32-b899-7b60367ece77 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.604664 Jul 28 10:41:20.770285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 338/697] 10.222.0.25 () {62 vars in 1188 bytes} [Wed Jul 28 10:41:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 10:41:20.779941 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7fcbbe24-cc42-478f-9058-0491e939c3b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:20.780562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7fcbbe24-cc42-478f-9058-0491e939c3b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:20.840420 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7fcbbe24-cc42-478f-9058-0491e939c3b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:20.848473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7fcbbe24-cc42-478f-9058-0491e939c3b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:20.849998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7fcbbe24-cc42-478f-9058-0491e939c3b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:20.851060 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7fcbbe24-cc42-478f-9058-0491e939c3b7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1281 microversion: 2.20 time: 0.074747 Jul 28 10:41:20.851592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 360/698] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:20 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:21.872304 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:21.874641 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:21.883048 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:21.884258 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:21.885336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:21.886670 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:21.965486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:21.975336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:21.976900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:21.978699 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ba0845be-f9c8-45fd-a84b-f1dc9482a1c2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1351 microversion: 2.20 time: 0.112250 Jul 28 10:41:21.979252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 339/699] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:21 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:22.995944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:22.996648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:23.002816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:23.003329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:23.004171 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:23.004677 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:23.263329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:23.273525 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:23.276169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:23.278973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b873cbca-4ca5-4f42-95e0-5e8ef1396f21 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.286019 Jul 28 10:41:23.291023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 361/700] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:22 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:23.386937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-e03b8034-ad2e-4e52-9c1d-0e046cfb1bb5 req-3936418d-d34d-45ce-9117-33731fc765ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:23.388565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:23.388565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:41:23.396793 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-e03b8034-ad2e-4e52-9c1d-0e046cfb1bb5 req-3936418d-d34d-45ce-9117-33731fc765ef service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:23.398586 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-e03b8034-ad2e-4e52-9c1d-0e046cfb1bb5 req-3936418d-d34d-45ce-9117-33731fc765ef service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:23.410999 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-e03b8034-ad2e-4e52-9c1d-0e046cfb1bb5 req-3936418d-d34d-45ce-9117-33731fc765ef service nova] Creating event network-changed:57f09889-bfea-4347-a33a-864b214d8f2c for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 on hv-cinder-80043 Jul 28 10:41:23.416612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-e03b8034-ad2e-4e52-9c1d-0e046cfb1bb5 req-3936418d-d34d-45ce-9117-33731fc765ef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Jul 28 10:41:23.417493 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 340/701] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:24.296569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:24.297156 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:24.302949 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:24.303396 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:24.304166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:24.304607 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:24.434063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:24.451960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:24.454452 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:24.455569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-63213a61-4861-472e-ae0f-d6fab031b825 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.162866 Jul 28 10:41:24.456120 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 362/702] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:24 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:25.474061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:25.474741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:25.481171 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:25.481626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:25.482403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:25.482841 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:25.637682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:25.645782 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:25.652018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:25.656885 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c21ca2b2-5c1f-4061-946c-e2a50f3d7f9d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.183749 Jul 28 10:41:25.657809 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 341/703] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:25 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:25.858195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:25.858696 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:25.869141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:25.869594 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:25.870384 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:25.870823 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:25.903196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:41:26.003055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9843d6b8-d59e-418c-84c6-4f4095643d71 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 204 len: 0 microversion: 2.1 time: 0.148090 Jul 28 10:41:26.004233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 363/704] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:41:25 2021] DELETE /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:41:26.014031 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:26.015101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:26.025675 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:26.026348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:26.027288 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:26.027900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:26.174991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:26.182751 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4162550f-59f1-4f15-9b77-8916fa2379ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1675 microversion: 2.1 time: 0.174076 Jul 28 10:41:26.183456 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 342/705] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:26 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:26.676043 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:26.676738 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:26.683311 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:26.683818 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:26.684587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:26.685052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:26.810479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:26.818747 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:26.820221 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:26.821988 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ce8645b8-c455-4b03-9927-41c75ebc96fb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.150056 Jul 28 10:41:26.822565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 364/706] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:26 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:41:27.200107 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:27.201359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:27.208310 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:27.208792 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:27.209696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:27.210142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:27.340299 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:27.347871 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-501ed3ce-b4b2-44d9-9693-7426e9e6b803 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1675 microversion: 2.1 time: 0.151713 Jul 28 10:41:27.348526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 343/707] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:27 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:27.839765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:27.841075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:27.847004 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:27.847498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:27.848267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:27.848706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:27.969513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:27.978273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:27.979767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:27.980877 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4e956de3-b3a2-4729-9aad-6405bb144a27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.145329 Jul 28 10:41:27.981429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 365/708] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:27 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:28.365711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:28.367075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:28.373584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:28.374049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:28.375068 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:28.375582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:28.508075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:28.516211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-32cc3afe-863c-428a-9a9a-214d0e53f4bf tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1675 microversion: 2.1 time: 0.154471 Jul 28 10:41:28.520786 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 344/709] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:28 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:28.999174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:28.999790 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:29.005712 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:29.006162 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:29.006928 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:29.007368 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:29.270210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:29.278614 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:29.280100 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:29.282860 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f272fbc6-deaa-4b3f-a641-faa7c1f7473e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.286181 Jul 28 10:41:29.282860 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 366/710] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:28 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:29.457734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-165355fb-c7cd-464e-b0f6-bda9b9acb6aa req-06452427-0342-4838-82e9-1d588b939dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1075c593-6301-4ed9-b795-78c416194982", "name": "network-vif-deleted", "tag": "b2d77924-3a3e-4775-b174-f86027863c1c"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:29.463498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:29.463498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:41:29.471503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-165355fb-c7cd-464e-b0f6-bda9b9acb6aa req-06452427-0342-4838-82e9-1d588b939dcc service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:29.472276 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-165355fb-c7cd-464e-b0f6-bda9b9acb6aa req-06452427-0342-4838-82e9-1d588b939dcc service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:29.492136 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-165355fb-c7cd-464e-b0f6-bda9b9acb6aa req-06452427-0342-4838-82e9-1d588b939dcc service nova] Creating event network-vif-deleted:b2d77924-3a3e-4775-b174-f86027863c1c for instance 1075c593-6301-4ed9-b795-78c416194982 on hv-cinder-80043 Jul 28 10:41:29.498764 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-165355fb-c7cd-464e-b0f6-bda9b9acb6aa req-06452427-0342-4838-82e9-1d588b939dcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044735 Jul 28 10:41:29.503481 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 345/711] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:29.534157 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:29.534775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:29.542996 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:29.549731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:29.551033 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:29.551637 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:29.616808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:29.626278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3dd16300-cdc0-4039-b24d-85608d9b45ae tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 200 len: 1323 microversion: 2.1 time: 0.095823 Jul 28 10:41:29.636838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 367/712] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:29 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 1323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:30.299814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:30.300665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:30.308795 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:30.309324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:30.310176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:30.310703 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:30.444340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:30.453835 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:30.455712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:30.458465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-225d6ec9-d11b-4dc5-8928-effe9b2a2ea9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.162719 Jul 28 10:41:30.459767 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 346/713] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:30 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:30.642994 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:30.644134 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:30.650670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:30.651306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:30.652255 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:30.652888 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:30.671870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] HTTP exception thrown: Instance 1075c593-6301-4ed9-b795-78c416194982 could not be found. Jul 28 10:41:30.672796 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Returning 404 to user: Instance 1075c593-6301-4ed9-b795-78c416194982 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:41:30.673808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c9137a29-cc68-4fba-96cf-7a6e94b24914 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 404 len: 111 microversion: 2.1 time: 0.034516 Jul 28 10:41:30.674973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 368/714] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:30 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:41:30.684433 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-026b84f4-fb0d-4857-9f10-4bbf3f2906e8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '.version_select at 0x7fe4777779d0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:30.713956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-026b84f4-fb0d-4857-9f10-4bbf3f2906e8 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375017029" status: 202 len: 0 microversion: 2.1 time: 0.034714 Jul 28 10:41:30.714854 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 347/715] 10.222.0.25 () {58 vars in 1221 bytes} [Wed Jul 28 10:41:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375017029 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:31.400383 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-64efdea4-9d78-49a1-872e-46c51f788e3d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: .version_select at 0x7fe477779940>, body: {"keypair": {"name": "tempest-keypair-664296924"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:31.419099 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-64efdea4-9d78-49a1-872e-46c51f788e3d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:41:31.423080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-64efdea4-9d78-49a1-872e-46c51f788e3d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for user 99b1261478f8499da914a9b8162a54e1 and project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:41:31.478459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:31.479708 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:31.486142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:31.486747 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:31.487754 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:31.488427 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:31.526876 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-64efdea4-9d78-49a1-872e-46c51f788e3d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:41:31.531430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-64efdea4-9d78-49a1-872e-46c51f788e3d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for user 99b1261478f8499da914a9b8162a54e1 and project 64f97a7ceb6d4d14928726470b026565. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:41:31.547385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-64efdea4-9d78-49a1-872e-46c51f788e3d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.151202 Jul 28 10:41:31.548401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 369/716] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Jul 28 10:41:31 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:31.651674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:31.660992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:31.662775 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:31.665214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b7df94eb-a821-4898-bc82-270e5337db03 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.190328 Jul 28 10:41:31.665956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 348/717] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:31 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:32.658931 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-8f75911c-6bf6-4e80-acad-a4199fe97c3d req-73f3028e-c100-463a-9572-5eb836547136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "name": "network-vif-plugged", "status": "completed", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:32.661481 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:32.661481 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:41:32.670479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-8f75911c-6bf6-4e80-acad-a4199fe97c3d req-73f3028e-c100-463a-9572-5eb836547136 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:32.671436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-8f75911c-6bf6-4e80-acad-a4199fe97c3d req-73f3028e-c100-463a-9572-5eb836547136 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:32.684876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:32.686281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:32.692567 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:32.696420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:32.701726 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-8f75911c-6bf6-4e80-acad-a4199fe97c3d req-73f3028e-c100-463a-9572-5eb836547136 service nova] Creating event network-vif-plugged:57f09889-bfea-4347-a33a-864b214d8f2c for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 on hv-cinder-80043 Jul 28 10:41:32.703025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:32.703659 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:32.717468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-8f75911c-6bf6-4e80-acad-a4199fe97c3d req-73f3028e-c100-463a-9572-5eb836547136 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066172 Jul 28 10:41:32.719134 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 370/718] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:41:32.919604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:32.928801 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:32.931268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:32.933377 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e1198813-22ae-4f49-8d65-b06694c81097 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.253578 Jul 28 10:41:32.934212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 349/719] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:32 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:41:33.014296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-173229408", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99b05afa-3957-4d6b-b545-1d387f52d9e8"}], "security_groups": [{"name": "tempest-securitygroup--167870417"}], "key_name": "tempest-keypair-664296924", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:33.105806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] validate_networks() for [('99b05afa-3957-4d6b-b545-1d387f52d9e8', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:41:33.717849 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:41:33.718426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:41:33.718752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:41:33.719151 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:41:33.719558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:41:33.728352 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:33.728829 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:33.729621 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:33.730048 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:33.747642 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for project 64f97a7ceb6d4d14928726470b026565. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:41:33.751291 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Getting quotas for user 99b1261478f8499da914a9b8162a54e1 and project 64f97a7ceb6d4d14928726470b026565. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:41:33.763242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:41:33.766038 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:41:33.811092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [48f37438-4126-4d75-a027-78a9283efd3c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:41:33.951824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:33.952437 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:33.958285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:33.958744 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:33.959512 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:33.959954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:34.109191 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:34.121324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:34.123092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:34.124219 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fb998003-db64-4658-b8b1-c4c41e427858 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1407 microversion: 2.20 time: 0.176124 Jul 28 10:41:34.124820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 350/720] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:33 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:41:34.827288 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [48f37438-4126-4d75-a027-78a9283efd3c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58114. Jul 28 10:41:34.831264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4638b7e8-7db1-4702-bc61-65ce2cc8a64f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.821221 Jul 28 10:41:34.832279 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 371/721] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:41:33 2021] POST /compute/v2.1/servers => generated 401 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:41:34.842313 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ed8cd2ea-f988-4d4f-bafa-54dada99ce1e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:34.843045 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ed8cd2ea-f988-4d4f-bafa-54dada99ce1e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:34.907529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ed8cd2ea-f988-4d4f-bafa-54dada99ce1e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:34.914086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ed8cd2ea-f988-4d4f-bafa-54dada99ce1e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1236 microversion: 2.1 time: 0.075313 Jul 28 10:41:34.914623 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 351/722] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:34 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:35.144596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:35.145328 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:35.152330 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:35.152769 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:35.153559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:35.153996 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:35.276227 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:35.284857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:35.286426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:35.287658 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4ab07539-3518-4143-8a50-41a89b086de1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1599 microversion: 2.20 time: 0.146682 Jul 28 10:41:35.288268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 372/723] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:41:35 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:41:35.306787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:35.307413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:35.313404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:35.313864 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:35.314629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:35.315065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:35.456722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b4281188-820e-40e4-b152-ceb4ad0fb15b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153501 Jul 28 10:41:35.457551 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 352/724] 10.222.0.25 () {60 vars in 1316 bytes} [Wed Jul 28 10:41:35 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:41:35.932558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-abe7af45-4a6e-483e-a5d6-dc6be3177b16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:35.934421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-abe7af45-4a6e-483e-a5d6-dc6be3177b16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:36.003926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-abe7af45-4a6e-483e-a5d6-dc6be3177b16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:36.010756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-abe7af45-4a6e-483e-a5d6-dc6be3177b16 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1236 microversion: 2.1 time: 0.083091 Jul 28 10:41:36.012029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 373/725] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:35 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:36.777497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:36.778645 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:36.783351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-b5df63b9-bed6-41c8-9018-458e0e3d1c43 req-df61ceb8-74ae-42b0-b332-6e3ad0335808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:36.784942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:36.784942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:41:36.786101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:36.786556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:36.790425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:36.791161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:36.792682 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-b5df63b9-bed6-41c8-9018-458e0e3d1c43 req-df61ceb8-74ae-42b0-b332-6e3ad0335808 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:36.793194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-b5df63b9-bed6-41c8-9018-458e0e3d1c43 req-df61ceb8-74ae-42b0-b332-6e3ad0335808 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:36.814901 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-b5df63b9-bed6-41c8-9018-458e0e3d1c43 req-df61ceb8-74ae-42b0-b332-6e3ad0335808 service nova] Creating event network-changed:57f09889-bfea-4347-a33a-864b214d8f2c for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 on hv-cinder-80043 Jul 28 10:41:36.823468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-b5df63b9-bed6-41c8-9018-458e0e3d1c43 req-df61ceb8-74ae-42b0-b332-6e3ad0335808 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043882 Jul 28 10:41:36.824460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 374/726] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:41:36.902798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-263ff2a4-16a2-483d-99d0-257a057536be tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.129226 Jul 28 10:41:36.903604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 353/727] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:36 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:37.030729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9eee9447-8cc3-4978-b327-55d418ec22e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:37.032139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9eee9447-8cc3-4978-b327-55d418ec22e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:37.111526 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9eee9447-8cc3-4978-b327-55d418ec22e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:37.119537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9eee9447-8cc3-4978-b327-55d418ec22e4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1236 microversion: 2.1 time: 0.093454 Jul 28 10:41:37.120739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 375/728] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:37 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:37.914947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:37.916107 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:37.923028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:37.923483 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:37.924365 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:37.926215 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:38.008786 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-82182dfd-60b5-4045-8ce5-4d2128425307 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.098293 Jul 28 10:41:38.009954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 354/729] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:37 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:38.136853 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-afa0a931-2907-4e4f-9034-090d7b1c0b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:38.137454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-afa0a931-2907-4e4f-9034-090d7b1c0b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:38.202773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-afa0a931-2907-4e4f-9034-090d7b1c0b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:38.210007 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-afa0a931-2907-4e4f-9034-090d7b1c0b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1236 microversion: 2.1 time: 0.076870 Jul 28 10:41:38.212682 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 376/730] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:38 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:39.019682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:39.020659 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:39.027545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:39.027991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:39.032594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:39.032594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:39.109856 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d319be1a-94d0-4a13-b79c-1746d837b75f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.093884 Jul 28 10:41:39.110524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 355/731] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:39 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:39.228908 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:39.229545 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:39.235839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:39.236390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:39.237191 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:39.237998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:39.299684 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:39.307649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3152bde2-f6cd-48f9-8da8-ad5d859b2509 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1240 microversion: 2.1 time: 0.083001 Jul 28 10:41:39.308294 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 377/732] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:39 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:40.121524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:40.122773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:40.129273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:40.129973 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:40.131491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:40.131931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:40.235309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e2ea2293-01e7-495e-9a83-23df4a622280 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.117820 Jul 28 10:41:40.235950 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 356/733] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:40 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:40.324124 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:40.325367 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:40.331303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:40.331977 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:40.332969 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:40.333566 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:40.420035 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:40.428529 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-feed73b1-4b27-4c95-8bb2-449fcc9dfcc9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1294 microversion: 2.1 time: 0.108860 Jul 28 10:41:40.429203 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 378/734] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:40 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1294 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:41.246356 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:41.248130 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:41.254585 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:41.255238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:41.256201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:41.256822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:41.340444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-01b6343e-776e-42c3-9711-e3c35e7c1d16 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.098337 Jul 28 10:41:41.341829 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 357/735] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:41 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:41.449008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:41.450251 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:41.458571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:41.459258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:41.460220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:41.460841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:41.712244 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:41.722395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-59d90d39-49a9-41da-82eb-9c2e2d8755de tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.280332 Jul 28 10:41:41.733681 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 379/736] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:41 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:41.787928 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-6a4629ad-3441-4728-8e32-ee9610742b8e req-bd90d494-f1b3-4ae8-9b2d-abeaa4b3874a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99d7091-6a64-45bd-83fe-050332612e8b", "tag": "26a3b716-ff5a-4338-a882-aad89e4ed3d7"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:41.797049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:41.797049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:41:41.811633 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-6a4629ad-3441-4728-8e32-ee9610742b8e req-bd90d494-f1b3-4ae8-9b2d-abeaa4b3874a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:41.812381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-6a4629ad-3441-4728-8e32-ee9610742b8e req-bd90d494-f1b3-4ae8-9b2d-abeaa4b3874a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:41.826806 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-6a4629ad-3441-4728-8e32-ee9610742b8e req-bd90d494-f1b3-4ae8-9b2d-abeaa4b3874a service nova] Creating event network-changed:26a3b716-ff5a-4338-a882-aad89e4ed3d7 for instance d99d7091-6a64-45bd-83fe-050332612e8b on hv-cinder-80043 Jul 28 10:41:41.836026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-6a4629ad-3441-4728-8e32-ee9610742b8e req-bd90d494-f1b3-4ae8-9b2d-abeaa4b3874a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051936 Jul 28 10:41:41.839444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 358/737] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:42.352631 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:42.353680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:42.360199 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:42.361220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:42.361993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:42.362421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:42.467896 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-01d27130-d7dc-499c-97f9-fd051e8bf697 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.119724 Jul 28 10:41:42.468572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 380/738] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:42 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:42.742845 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:42.743754 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:42.752082 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:42.752541 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:42.754389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:42.755344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:42.901019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:42.909501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4fdc75bc-7ea0-4ade-8e45-72b176acd096 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.172220 Jul 28 10:41:42.910398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 359/739] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:42 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:43.485068 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:43.485068 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:43.489094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:43.489822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:43.490915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:43.491291 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:43.577750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-128a2f15-e4f5-4c7b-b6ad-63e038edf652 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.101019 Jul 28 10:41:43.579054 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 381/740] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:43 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:43.926342 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:43.926948 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:43.933525 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:43.933967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:43.934726 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:43.935156 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:44.059519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:44.066750 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-50859523-b87d-4d68-9eb1-02cb4ad04a42 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.144035 Jul 28 10:41:44.067319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 360/741] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:43 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:44.591206 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:44.592524 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:44.599448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:44.600026 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:44.601365 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:44.601365 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:44.683500 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a5c6adf9-defd-44f9-b2fd-28ece267cc5b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 14 microversion: 2.20 time: 0.096162 Jul 28 10:41:44.684230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 382/742] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:44 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:45.083787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:45.084454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:45.092240 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:45.092690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:45.093513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:45.094005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:45.228170 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:45.236168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c9da7043-d68c-4dce-bd3a-17bc1d0c4237 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.156394 Jul 28 10:41:45.236766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 361/743] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:45 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:45.696140 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:45.697160 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:45.703631 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:45.704086 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:45.704924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:45.705360 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:46.253753 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:46.254360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:46.261197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:46.261642 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:46.262401 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:46.262832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:46.384884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:46.392848 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-585e0daf-ede1-4765-adac-3d1352b987df tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.142689 Jul 28 10:41:46.393417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 362/744] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:46 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:47.410271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:47.410956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:47.417676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:47.418124 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:47.418888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:47.419324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:47.545673 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:47.552908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-62dacb67-a1bc-44a1-b0da-c0395367dda4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.146370 Jul 28 10:41:47.553477 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 363/745] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:47 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:47.804423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:47.805010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:47.811273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:47.811747 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:47.812583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:47.813035 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:47.840211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lazy-loading 'flavor' on Instance uuid fe05f242-2582-45fb-8d05-c98f329b76e0 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:41:47.866820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-837e47e8-a161-409d-856e-81a125e7859a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 15025 microversion: 2.20 time: 2.174519 Jul 28 10:41:47.867983 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 383/746] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:45 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 15025 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:47.918892 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-da428303-cead-40ba-b962-91c65edc0dbf tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "POST /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0/action" status: 202 len: 0 microversion: 2.1 time: 0.117914 Jul 28 10:41:47.919517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 364/747] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:41:47 2021] POST /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:41:47.927988 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:47.928874 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:47.936502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:47.937228 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:47.938555 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:47.938921 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:48.069483 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:48.077603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f4fb31fc-cec0-4f38-910d-4252c7c7ae38 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.153670 Jul 28 10:41:48.078177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 384/748] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:47 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:48.570341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:48.571036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:48.577326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:48.577774 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:48.578539 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:48.578974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:48.709890 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:48.718006 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5fdd147d-5e5f-452c-88ec-af3e59e42c25 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.151710 Jul 28 10:41:48.718578 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 365/749] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:48 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:48.878827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:48.879793 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:48.886370 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:48.886808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:48.887571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:48.888001 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:48.988498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-657a10e1-9531-4a17-a8e5-37e8a728d9db tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 17960 microversion: 2.20 time: 0.113237 Jul 28 10:41:48.989373 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 385/750] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:48 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 17960 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:49.094972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:49.095607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:49.105730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:49.105730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:49.105730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:49.105730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:49.233999 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:49.243309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dc8e901f-2786-4439-a4f1-da126226c8ff tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.151220 Jul 28 10:41:49.243309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 366/751] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:49 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:49.735063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:49.735828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:49.742447 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:49.742889 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:49.743653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:49.744613 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:49.873354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:49.880808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2b2c5ac3-3a1e-4137-b885-cffc48e09764 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.149638 Jul 28 10:41:49.881399 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 386/752] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:49 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:50.000478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:50.001331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:50.007253 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:50.007701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:50.008465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:50.008930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:50.261693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:50.262220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:50.268103 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:50.268549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:50.269359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:50.269798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:50.391065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:50.398824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f3eaf229-2512-420b-99ed-58b97b7b38b2 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.141402 Jul 28 10:41:50.399408 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 387/753] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:50 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:50.897583 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:50.898405 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:50.905077 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:50.905522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:50.906284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:50.906712 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:51.030444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:51.037871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3b162a05-cf51-4db8-a892-de248c550fa4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.143902 Jul 28 10:41:51.038462 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 388/754] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:50 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:51.415700 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:51.416336 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:51.422414 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:51.422862 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:51.423635 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:51.424072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:51.553101 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:51.562991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-46e636ad-a2cd-4672-adfa-ba6323d7dcf8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.151021 Jul 28 10:41:51.563573 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 389/755] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:51 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:52.055875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:52.056787 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:52.063512 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:52.063669 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:52.064630 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:52.065112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:52.196212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:52.204460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e7b79054-8030-4a18-a54a-802569ebefe9 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.153017 Jul 28 10:41:52.205184 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 390/756] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:52 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:52.345830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7f3c4570-a35e-4e7b-b458-dbf2032a80f3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 22534 microversion: 2.20 time: 2.349202 Jul 28 10:41:52.346487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 367/757] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:49 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 22534 bytes in 2351 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:52.459899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-e4417970-a0ff-4e1c-9f7a-9fca58990152 req-d2a348ac-3d11-4eed-80d9-5c1f84e374a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99d7091-6a64-45bd-83fe-050332612e8b", "name": "network-vif-plugged", "status": "completed", "tag": "26a3b716-ff5a-4338-a882-aad89e4ed3d7"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:52.461440 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:52.461440 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:41:52.469620 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-e4417970-a0ff-4e1c-9f7a-9fca58990152 req-d2a348ac-3d11-4eed-80d9-5c1f84e374a1 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:52.470086 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-e4417970-a0ff-4e1c-9f7a-9fca58990152 req-d2a348ac-3d11-4eed-80d9-5c1f84e374a1 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:52.485024 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-e4417970-a0ff-4e1c-9f7a-9fca58990152 req-d2a348ac-3d11-4eed-80d9-5c1f84e374a1 service nova] Creating event network-vif-plugged:26a3b716-ff5a-4338-a882-aad89e4ed3d7 for instance d99d7091-6a64-45bd-83fe-050332612e8b on hv-cinder-80043 Jul 28 10:41:52.490239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-e4417970-a0ff-4e1c-9f7a-9fca58990152 req-d2a348ac-3d11-4eed-80d9-5c1f84e374a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034029 Jul 28 10:41:52.490822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 391/758] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:52.581720 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:52.582406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:52.592178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:52.592728 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:52.593696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:52.594212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:52.724356 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:52.732543 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-56107f7b-e523-4ecb-b75d-f3b855f3e547 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.154730 Jul 28 10:41:52.733375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 368/759] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:52 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:53.222299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:53.222991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:53.230105 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:53.230548 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:53.231309 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:53.231740 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:53.357437 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:53.358460 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:53.365974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:53.375234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:53.375801 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:53.376465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:53.376941 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:53.377920 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2ceed6ee-3398-4a3a-be72-19ffcb8afcab tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.159501 Jul 28 10:41:53.381304 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 392/760] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:53 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:53.488758 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f36d0db2-92a6-4b92-8364-018d4f281e3e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 23221 microversion: 2.20 time: 0.135663 Jul 28 10:41:53.489637 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 369/761] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:53 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 23221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:41:53.750083 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:53.750692 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:53.756584 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:53.757062 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:53.757831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:53.758264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:53.877309 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:53.885381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0f89a072-e234-425a-80f9-69af71a3f14a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.138649 Jul 28 10:41:53.885998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 393/762] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:53 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:54.394811 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:54.395504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:54.402268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:54.402714 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:54.403503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:54.403889 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:54.500050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:54.500992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:54.506856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:54.507300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:54.508079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:54.508568 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:54.526935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:54.534588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e186c428-a055-48ab-a3b1-5dc0830c70aa tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.143722 Jul 28 10:41:54.535163 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 370/763] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:54 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:54.902581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:54.903189 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:54.909459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:54.909905 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:54.910664 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:54.911097 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:55.036459 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:55.044539 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a644dcf0-6e40-4780-aaf0-a0161127c6e3 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.146111 Jul 28 10:41:55.045148 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 371/764] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:54 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:55.552849 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:55.553519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:55.559979 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:55.560422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:55.561207 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:55.561635 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:55.687208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:55.694788 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f544596e-d2ac-4e04-a468-5c30788ac014 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.145615 Jul 28 10:41:55.695356 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 372/765] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:55 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:56.062132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:56.062782 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:56.068637 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:56.069118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:56.069884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:56.070320 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:56.193299 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:56.202563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ad634bed-6950-40d4-8f59-c41dae8e88d4 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.144034 Jul 28 10:41:56.208779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 373/766] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:56 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:41:56.690834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-17e6d98d-2afe-4e14-a711-eb29b0f8f4bb tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 26343 microversion: 2.20 time: 2.194454 Jul 28 10:41:56.691666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 394/767] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:54 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 26343 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:41:56.725245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:56.725245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:56.725245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:56.725245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:56.726115 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:56.726115 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:56.840821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:56.847935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cd07d13b-f6b6-4d4a-8dad-4bcc09141935 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1361 microversion: 2.1 time: 0.139468 Jul 28 10:41:56.848497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 374/768] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:56 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1361 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:57.219786 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:57.220482 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:57.227118 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:57.227565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:57.228332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:57.228780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:57.349753 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:57.358443 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9924d8ed-d1c8-4566-9e7c-1372624f9529 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.142686 Jul 28 10:41:57.359245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 395/769] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:57 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:57.702412 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:57.703336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:57.709758 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:57.710201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:57.710978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:57.711413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:57.821626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-201d9e7d-208a-4153-bca9-5cdb13283892 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 27172 microversion: 2.20 time: 0.122719 Jul 28 10:41:57.822269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 375/770] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:57 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 27172 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:57.864353 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:57.865195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:57.871450 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:57.872149 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:57.872955 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:57.873396 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:57.998615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:58.006511 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-74267a4c-adcf-4183-8f0c-7d76950d1f54 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1548 microversion: 2.1 time: 0.145703 Jul 28 10:41:58.007072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 396/771] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:57 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:58.022755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:58.023336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:58.030935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:58.031390 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:58.032165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:58.032606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:58.116535 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1c1979c2-842f-4ec2-99d1-971ff8e305bb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097573 Jul 28 10:41:58.117178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 376/772] 10.222.0.25 () {58 vars in 1275 bytes} [Wed Jul 28 10:41:58 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:58.376431 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:58.377071 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:58.383259 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:58.383706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:58.384472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:58.384987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:58.606969 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:58.614226 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0efad6f5-40ec-475c-8f0a-71253eece474 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.241479 Jul 28 10:41:58.614805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 397/773] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:58 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:58.833478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:58.834382 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:58.840949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:58.841443 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:58.842232 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:58.842673 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:58.964269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b42d34b7-dede-48e8-831f-280abbc57a36 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 27691 microversion: 2.20 time: 0.133571 Jul 28 10:41:58.965112 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 377/774] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:58 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 27691 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:41:59.366475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:59.368578 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-42f78be2-8723-4436-a2a7-81c7523adda7 req-c67a2a6f-7fbf-4ce0-833f-559308ef4364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99d7091-6a64-45bd-83fe-050332612e8b", "tag": "26a3b716-ff5a-4338-a882-aad89e4ed3d7"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:59.369210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:59.373328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:41:59.373328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:41:59.384429 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-42f78be2-8723-4436-a2a7-81c7523adda7 req-c67a2a6f-7fbf-4ce0-833f-559308ef4364 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.384908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-42f78be2-8723-4436-a2a7-81c7523adda7 req-c67a2a6f-7fbf-4ce0-833f-559308ef4364 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:59.388075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.388539 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:59.389924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.390392 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:59.400539 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-42f78be2-8723-4436-a2a7-81c7523adda7 req-c67a2a6f-7fbf-4ce0-833f-559308ef4364 service nova] Creating event network-changed:26a3b716-ff5a-4338-a882-aad89e4ed3d7 for instance d99d7091-6a64-45bd-83fe-050332612e8b on hv-cinder-80043 Jul 28 10:41:59.406927 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-42f78be2-8723-4436-a2a7-81c7523adda7 req-c67a2a6f-7fbf-4ce0-833f-559308ef4364 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045634 Jul 28 10:41:59.408229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 378/775] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:41:59.500605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4b920e27-721f-4ca3-ac4c-758526590581 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.142508 Jul 28 10:41:59.503914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 398/776] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:41:59 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:41:59.632611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:41:59.633934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:59.641949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.642480 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:59.643355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.643852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:59.779382 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:41:59.786824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5280f388-1379-4559-8429-c035689fbdd9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.158240 Jul 28 10:41:59.787394 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 379/777] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:41:59 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:41:59.977920 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:41:59.979628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:41:59.986002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.986444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:41:59.987205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:41:59.987631 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:00.117066 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1c6f401b-85a4-4cb1-8ba9-c67e403c6b47 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 27984 microversion: 2.20 time: 0.143074 Jul 28 10:42:00.117721 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 399/778] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:41:59 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 27984 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:00.511853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:00.512755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:00.519293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:00.519748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:00.520564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:00.521018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:00.610149 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-96c31009-6ac6-4ac0-ad10-369d5130c6bd tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.102150 Jul 28 10:42:00.610775 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 380/779] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:00 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:00.804093 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:00.804771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:00.811239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:00.811684 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:00.812448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:00.812914 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:00.931074 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:00.938880 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-afc07523-35ff-4d7b-8950-d8ce2661d1e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.138912 Jul 28 10:42:00.939450 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 400/780] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:00 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:01.129425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:01.130442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:01.137048 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:01.137501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:01.138253 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:01.138680 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:01.250421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-dc4b1698-ed6c-4c5d-ad99-46253a0b8f9f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28173 microversion: 2.20 time: 0.124927 Jul 28 10:42:01.251042 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 381/781] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:01 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28173 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:01.621056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:01.622278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:01.627986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:01.628442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:01.629247 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:01.629688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:01.712175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3e0881ea-703c-4ddb-9bad-bbea5ebe2676 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.094677 Jul 28 10:42:01.712287 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 401/782] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:01 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:01.956904 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:01.957607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:01.964203 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:01.964597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:01.965397 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:01.965836 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:02.083443 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:02.090867 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-58240e17-6aa2-479d-aa31-04a673bd03f9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.138061 Jul 28 10:42:02.091428 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 382/783] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:01 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:02.261565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:02.262499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:02.268968 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:02.269424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:02.270195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:02.270638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:02.359255 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3c2c9c0f-5194-4f3d-b942-439cc536c3f4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28173 microversion: 2.20 time: 0.101769 Jul 28 10:42:02.359878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 402/784] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:02 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28173 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:02.723543 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:02.724477 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:02.731204 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:02.731653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:02.732425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:02.732883 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:02.829936 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-96a01891-fc46-4bfa-8d05-11c38cd6ecda tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.109820 Jul 28 10:42:02.830596 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 383/785] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:02 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:03.110023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:03.110507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:03.117243 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:03.117694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:03.118469 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:03.118907 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:03.248460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:03.257060 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-baabc4a4-f81d-457e-bdc6-1cf5b0c3d20e tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.152792 Jul 28 10:42:03.257664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 403/786] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:03 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:03.372509 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:03.373557 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:03.380655 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:03.381129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:03.382099 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:03.382592 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:03.476510 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-907fd031-cd01-4d4d-aac3-5a0f7138d115 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28300 microversion: 2.20 time: 0.108865 Jul 28 10:42:03.477231 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 384/787] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:03 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:03.841613 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:03.842448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:03.848185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:03.848625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:03.849425 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:03.849857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:03.937088 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1405079b-5626-460a-8025-178543487877 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.099904 Jul 28 10:42:03.940301 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 404/788] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:03 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:04.275101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:04.276656 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:04.283765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:04.284338 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:04.285225 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:04.285765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:04.448889 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:04.456172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-de632152-9838-4070-b95d-f5fee2ba6579 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.185271 Jul 28 10:42:04.456771 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 385/789] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:04 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:04.488844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:04.489935 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:04.497288 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:04.497738 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:04.498513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:04.498949 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:04.597630 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a80528dd-db9b-4e6c-9d3a-c60ae6419957 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28464 microversion: 2.20 time: 0.112592 Jul 28 10:42:04.598269 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 405/790] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:04 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28464 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:42:04.947916 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:04.948858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:04.954709 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:04.955157 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:04.955959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:04.956392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:05.037548 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2b185cf1-746c-4509-ac74-59e28096806d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.093619 Jul 28 10:42:05.040552 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 386/791] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:04 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:05.476322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:05.477339 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:05.484330 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:05.484802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:05.485572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:05.486171 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:05.610237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:05.611237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:05.618087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:05.618550 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:05.619367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:05.619798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:05.723062 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-cceeefbb-c50b-40f7-a15c-b0c4066ccd64 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28632 microversion: 2.20 time: 0.117026 Jul 28 10:42:05.723783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 387/792] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:05 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28632 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:42:05.845092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:05.852544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b5dd2cbc-0470-473e-a995-b7b9de435a9b tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.383071 Jul 28 10:42:05.853203 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 406/793] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:05 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:06.048808 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:06.049937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:06.056693 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:06.057760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:06.058759 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:06.059268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:06.152436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5741f145-f404-4f3c-ae3e-25ff85eeaea1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.107569 Jul 28 10:42:06.153134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 388/794] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:06 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:06.735182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:06.736308 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:06.742926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:06.743458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:06.744380 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:06.744923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:06.834106 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-dbbc960e-b5ea-4abd-8237-afde57673d4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28632 microversion: 2.20 time: 0.102560 Jul 28 10:42:06.835779 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 407/795] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:06 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28632 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:06.870013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:06.870678 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:06.877704 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:06.878151 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:06.878919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:06.879352 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.167172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:07.168174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:07.175165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.175624 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.175743 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:07.176403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.176862 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.184773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c42bd71c-d23c-4f9d-ae52-442413cc9644 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1511 microversion: 2.1 time: 0.318941 Jul 28 10:42:07.185341 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 389/796] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:06 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:07.202049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:07.202576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:07.208832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.209282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.210044 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.210473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.283364 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f6cde5b5-d1e9-4e4e-bcad-84d7fd4001a1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.123967 Jul 28 10:42:07.286839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 408/797] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:07 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:42:07.290188 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f25906b3-200f-47eb-9597-ffd06aa835a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "POST /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0/action" status: 202 len: 0 microversion: 2.1 time: 0.093172 Jul 28 10:42:07.290938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 390/798] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:07 2021] POST /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:42:07.301508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:07.302204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:07.309672 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.310124 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.310922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.311362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.443072 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:07.453123 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0b2f48bd-7630-482d-bf94-d4e983d1f570 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1519 microversion: 2.1 time: 0.156908 Jul 28 10:42:07.453686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 409/799] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:07 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:07.847446 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:07.848852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:07.856069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.856511 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.857303 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:07.857733 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:07.954626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-51394f11-c4f1-4a09-befb-02fa2f5eaffd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 28632 microversion: 2.20 time: 0.111135 Jul 28 10:42:07.955458 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 391/800] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:07 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 28632 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:08.294394 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:08.295340 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:08.301095 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:08.301549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:08.302327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:08.302767 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:08.386959 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7a66c5d9-0c64-4b9e-9dff-6387d074e5c7 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.096777 Jul 28 10:42:08.387688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 410/801] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:08 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:42:08.471585 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:08.472272 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:08.478674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:08.479116 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:08.480999 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:08.481437 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:08.604183 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:08.611932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8914d4b2-68a6-4155-8110-0cd212fc318a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1521 microversion: 2.1 time: 0.144342 Jul 28 10:42:08.612682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 392/802] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:08 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:08.967991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:08.969345 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:08.976329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:08.976801 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:08.977593 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:08.978028 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:09.088079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e1c8f364-d1da-471b-ae0c-be39fcc19d51 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 29319 microversion: 2.20 time: 0.124873 Jul 28 10:42:09.092082 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 411/803] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:08 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 29319 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:09.399049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:09.399961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:09.411092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:09.411546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:09.412335 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:09.412777 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:09.502753 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-719081ce-98d7-437c-aff0-8ad016dfe0e6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 14 microversion: 2.1 time: 0.107399 Jul 28 10:42:09.503624 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 393/804] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:09 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 10:42:09.629521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:09.631444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:09.639953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:09.639953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:09.640518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:09.641037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:09.878845 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:09.887073 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7d97480c-23f7-4bf8-9c5a-ebf82ed53515 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.261577 Jul 28 10:42:09.888685 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 412/805] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:09 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:10.100794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:10.101817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:10.109049 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.109498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:10.110257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.110689 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:10.212024 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-553b5373-70ca-4204-a03c-69eb0f9327b3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 31013 microversion: 2.20 time: 0.115587 Jul 28 10:42:10.212657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 394/806] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:10 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 31013 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:10.513667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:10.514588 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:10.520538 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.521033 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:10.521800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.522230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:10.620912 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c91fbf92-3f3c-454e-ad97-700e057c9820 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 6882 microversion: 2.1 time: 0.110665 Jul 28 10:42:10.621563 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 413/807] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:10 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 6882 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:10.803616 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-700757e3-f7a8-4d3e-8b97-8811745df2be req-82aa5554-1b75-464d-a2de-6b2e1035ec6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "name": "network-vif-unplugged", "status": "completed", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:10.805296 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:42:10.805296 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:42:10.812684 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-700757e3-f7a8-4d3e-8b97-8811745df2be req-82aa5554-1b75-464d-a2de-6b2e1035ec6c service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.813185 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-700757e3-f7a8-4d3e-8b97-8811745df2be req-82aa5554-1b75-464d-a2de-6b2e1035ec6c service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:10.824178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-700757e3-f7a8-4d3e-8b97-8811745df2be req-82aa5554-1b75-464d-a2de-6b2e1035ec6c service nova] Creating event network-vif-unplugged:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:42:10.829421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-700757e3-f7a8-4d3e-8b97-8811745df2be req-82aa5554-1b75-464d-a2de-6b2e1035ec6c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029685 Jul 28 10:42:10.830214 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 395/808] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:42:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:42:10.906077 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:10.906768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:10.913436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.913965 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:10.914765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:10.915139 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:11.041677 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:11.050096 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fcc6bed6-d644-499a-a056-f39cf2b3fe57 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.149113 Jul 28 10:42:11.050680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 414/809] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:10 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:11.224465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:11.225620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:11.232120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:11.232567 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:11.233363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:11.233796 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:11.328870 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ad5c5400-02cb-4fbd-b528-c649f626073e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 32635 microversion: 2.20 time: 0.108278 Jul 28 10:42:11.329747 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 396/810] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:11 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 32635 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:11.631508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:11.632361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:11.639117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:11.639560 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:11.640320 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:11.640773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:11.751794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fb56aee4-c835-4822-a16d-0e76b1a3fb1b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 15025 microversion: 2.1 time: 0.123865 Jul 28 10:42:11.752430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 415/811] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:11 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 15025 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:12.067219 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:12.067916 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:12.074441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:12.075521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:12.076290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:12.076724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:12.199489 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:12.207658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-425d7f1a-66ad-43bb-9dd7-dd6de47305d0 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.144384 Jul 28 10:42:12.208349 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 397/812] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:12 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:12.341138 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:12.342406 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:12.349080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:12.349607 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:12.350488 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:12.351008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:12.457101 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c068d848-f133-477c-af58-3ba9f081d5d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 33445 microversion: 2.20 time: 0.120025 Jul 28 10:42:12.461176 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 416/813] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:12 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 33445 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:12.763655 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:12.764565 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:12.770609 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:12.771058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:12.771817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:12.772278 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:12.874983 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d01a94ec-1bc5-46e7-9892-7be22248969d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 18561 microversion: 2.1 time: 0.115026 Jul 28 10:42:12.875615 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 398/814] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:12 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 18561 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:13.225173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:13.225835 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:13.232202 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:13.233148 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:13.233908 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:13.234338 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:13.355578 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:13.363373 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-65866c52-4db4-4ca7-9c27-519a9ead390a tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.142335 Jul 28 10:42:13.363930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 417/815] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:13 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:13.469435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:13.470454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:13.476940 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:13.477334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:13.478088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:13.478517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:13.574065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-36755412-201e-43f4-84eb-4cce6426d330 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 34537 microversion: 2.20 time: 0.108721 Jul 28 10:42:13.575569 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 399/816] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:13 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 34537 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:13.885828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:13.886841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:13.893353 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:13.893879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:13.894727 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:13.895233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:14.000316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6c0937ce-af86-4c70-9afd-042506e90b0c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 20074 microversion: 2.1 time: 0.117853 Jul 28 10:42:14.000926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 418/817] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:13 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 20074 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:14.380518 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:14.381244 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:14.387702 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:14.388154 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:14.389564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:14.390001 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:14.518425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:14.527730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0f3948ab-49fc-488e-b631-385c831c79b8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.151174 Jul 28 10:42:14.528300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 400/818] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:14 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:14.586504 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:14.587705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:14.594303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:14.594844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:14.595688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:14.596193 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:14.693638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1f9e3bbb-38fd-456f-a20a-079d6c5d01d3 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 35781 microversion: 2.20 time: 0.110945 Jul 28 10:42:14.697791 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 419/819] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:14 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 35781 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:15.011729 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:15.012721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:15.019859 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:15.020394 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:15.021252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:15.021750 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:15.117246 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c4deeb02-2b6a-49ea-9381-dbbe2d3fff87 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 22724 microversion: 2.1 time: 0.109122 Jul 28 10:42:15.118159 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 401/820] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:15 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 22724 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:15.546600 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:15.547306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:15.554056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:15.554503 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:15.555282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:15.555715 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:15.683654 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:15.691306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ad2a0844-98ba-4cb1-8fe6-5b7bb9613769 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.149561 Jul 28 10:42:15.691871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 420/821] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:15 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:15.705394 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:15.706523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:15.713235 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:15.713682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:15.714445 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:15.714873 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:15.806798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-840f4270-5a79-4530-9598-0c583e4bb7d7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 37136 microversion: 2.20 time: 0.105448 Jul 28 10:42:15.807411 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 402/822] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:15 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 37136 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:16.128987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:16.129907 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:16.135909 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:16.136360 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:16.137165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:16.137602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:16.246280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-339ffb64-1dbe-4e56-aa59-725f00aed546 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 23811 microversion: 2.1 time: 0.120840 Jul 28 10:42:16.247186 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 421/823] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:16 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 23811 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:16.708522 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:16.709327 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:16.715840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:16.716271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:16.717566 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:16.718007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:16.819244 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:16.820247 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:16.827211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:16.827667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:16.828434 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:16.828892 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:16.836851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:16.845448 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-39fd3b87-3f1b-4007-8166-1aa0f9509a8d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1577 microversion: 2.1 time: 0.141018 Jul 28 10:42:16.846017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 403/824] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:16 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:16.923931 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7ccf808d-1279-4b42-b74c-6a168b78d7ca tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 38186 microversion: 2.20 time: 0.108590 Jul 28 10:42:16.924794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 422/825] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:16 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 38186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:42:17.257918 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:17.258822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:17.265233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:17.265682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:17.266442 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:17.266874 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:17.376021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8946d24e-198b-4550-9a07-5357ebceaf9e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 25054 microversion: 2.1 time: 0.121642 Jul 28 10:42:17.376638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 404/826] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:17 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 25054 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:17.861810 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:17.862537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:17.868973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:17.869422 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:17.870219 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:17.870652 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:17.936311 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:17.937344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:17.943893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:17.944340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:17.945161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:17.945598 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:17.991037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:17.999029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bf291b9f-da0c-49d6-9947-46c8ed03d7a8 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1564 microversion: 2.1 time: 0.141287 Jul 28 10:42:17.999596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 423/827] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:42:17 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1564 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:42:18.037652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-75e5462b-d8f3-4db0-b6ae-154352541a0c tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 38186 microversion: 2.20 time: 0.105949 Jul 28 10:42:18.038934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 405/828] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:17 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 38186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:18.387218 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:18.388168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:18.394421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:18.394868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:18.395628 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:18.396069 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:18.488424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-487fb414-c223-4777-98f4-803a03c6e576 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 26438 microversion: 2.1 time: 0.104737 Jul 28 10:42:18.489087 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 424/829] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:18 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 26438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:19.254687 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:19.255745 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:19.262330 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:19.262782 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:19.264273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:19.264713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:19.351701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0dff9617-0a2c-41dd-8b7a-2f14b65214cd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 38186 microversion: 2.20 time: 0.306261 Jul 28 10:42:19.352336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 406/830] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:19 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 38186 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:19.501270 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:19.502175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:19.508580 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:19.509059 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:19.509822 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:19.510260 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:19.605802 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-146d0324-5ed5-48eb-a86c-b92df032aafb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 27440 microversion: 2.1 time: 0.109397 Jul 28 10:42:19.606451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 425/831] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:19 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 27440 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:20.363832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:20.364846 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:20.371256 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.372350 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.373649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.374288 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.481579 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8f737d24-5187-4bd3-822e-27128e997905 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 200 len: 38327 microversion: 2.20 time: 0.121636 Jul 28 10:42:20.483014 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 407/832] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:20 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 38327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:42:20.493068 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:20.493647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:20.500949 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.501399 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.502164 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.502598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.525544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-29b82a96-13ae-4cd7-a683-313cf776ff27 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/ips" status: 200 len: 151 microversion: 2.20 time: 0.036512 Jul 28 10:42:20.526252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 426/833] 10.222.0.25 () {60 vars in 1289 bytes} [Wed Jul 28 10:42:20 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:20.618666 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:20.619665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:20.627521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.628000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.629006 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.629439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.723779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-12603d3e-e713-44e7-ad0c-598c32edc677 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 27960 microversion: 2.1 time: 0.109183 Jul 28 10:42:20.724964 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 408/834] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:20 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 27960 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:20.952397 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-649c5430-2e13-405b-bc4c-92c1af5fada6 req-cd6953ef-7b7e-472f-a724-3a44f551c1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "name": "network-vif-plugged", "status": "completed", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:20.954218 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:42:20.954218 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:42:20.961744 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-649c5430-2e13-405b-bc4c-92c1af5fada6 req-cd6953ef-7b7e-472f-a724-3a44f551c1ec service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:20.962224 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-649c5430-2e13-405b-bc4c-92c1af5fada6 req-cd6953ef-7b7e-472f-a724-3a44f551c1ec service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:20.978407 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-649c5430-2e13-405b-bc4c-92c1af5fada6 req-cd6953ef-7b7e-472f-a724-3a44f551c1ec service nova] Creating event network-vif-plugged:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:42:20.983697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-649c5430-2e13-405b-bc4c-92c1af5fada6 req-cd6953ef-7b7e-472f-a724-3a44f551c1ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035133 Jul 28 10:42:20.984596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 427/835] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:21.834374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:21.835397 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:21.841852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:21.842351 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:21.843074 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:21.843508 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:21.936705 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2879ed18-a4a4-43cd-b5e0-0bc25e7ac86f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 28273 microversion: 2.1 time: 0.204435 Jul 28 10:42:21.937364 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 409/836] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:21 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 28273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:22.598333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:22.598951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:22.605076 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:22.605526 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:22.606292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:22.606734 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:22.630109 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lazy-loading 'flavor' on Instance uuid 0745fdb0-bc0e-4283-9eaf-21f586727c30 {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:42:22.885471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f715ab83-5368-4558-94d1-c6da312093e9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 202 len: 0 microversion: 2.20 time: 0.291406 Jul 28 10:42:22.886084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 428/837] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:22 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 10:42:22.894849 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:22.895536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:22.902117 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:22.902590 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:22.903366 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:22.903817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:22.948461 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:22.949482 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:22.955670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:22.956114 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:22.956923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:22.957356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:23.026736 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:23.034807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:23.036283 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:23.037446 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-70ce23dd-ce86-4f15-af32-041c707c7706 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.146805 Jul 28 10:42:23.038030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 410/838] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:22 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:23.048311 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9990601a-14fd-483b-9a53-4cb903231333 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 28273 microversion: 2.1 time: 0.103802 Jul 28 10:42:23.048989 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 429/839] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:22 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 28273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:42:24.056766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:24.057388 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:24.060525 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:24.061543 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:24.064417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:24.064960 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:24.065721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:24.066149 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:24.067970 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:24.068420 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:24.069224 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:24.069655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:24.173841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b7b6401c-7681-4a2b-a22a-2e7b0c7d626f tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 28564 microversion: 2.1 time: 0.117558 Jul 28 10:42:24.174670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 430/840] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:24 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 28564 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 10:42:24.190688 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:24.198520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:24.200016 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:24.201906 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-3f7882d6-1639-4eac-8b71-404661c6581e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.149115 Jul 28 10:42:24.202455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 411/841] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:24 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:25.186190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:25.187192 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:25.193602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:25.194064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:25.194816 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:25.195249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:25.219749 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:25.220476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:25.226392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:25.226832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:25.227610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:25.228025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:25.300379 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-866f8f8b-2941-4bd7-b0f1-a8c4bf7b8420 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 28732 microversion: 2.1 time: 0.118067 Jul 28 10:42:25.301361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 431/842] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:25 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 28732 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:25.345240 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:25.352993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:25.354487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:25.355605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1e584a6e-e89e-4992-9417-880488a36c50 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.140248 Jul 28 10:42:25.356158 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 412/843] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:25 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:42:26.312830 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:26.313820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:26.320182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:26.320625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:26.321409 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:26.321837 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:26.374368 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:26.374986 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:26.381404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:26.381846 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:26.382614 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:26.383040 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:26.408861 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-32ff033b-8d0b-40b4-940f-1192c303d876 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 28732 microversion: 2.1 time: 0.100254 Jul 28 10:42:26.412800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 432/844] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:26 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 28732 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:26.502328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:26.509983 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:26.511466 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:26.512584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ee241f31-e5eb-490f-a2e6-b0f88960f97e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.142675 Jul 28 10:42:26.513162 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 413/845] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:26 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:42:27.421433 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:27.422437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:27.428924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:27.429382 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:27.430165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:27.430605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:27.512004 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d2841909-9330-4e68-b43e-613521396524 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 28732 microversion: 2.1 time: 0.095054 Jul 28 10:42:27.512622 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 433/846] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:27 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 28732 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:27.530425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:27.531042 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:27.537028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:27.537481 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:27.538242 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:27.538683 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:27.659069 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:27.666710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:27.668182 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:27.669957 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-325eb900-2b3d-4d39-9027-a0315918c7ce tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.142585 Jul 28 10:42:27.670536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 414/847] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:27 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:28.524193 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:28.525213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:28.532333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:28.532806 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:28.533571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:28.534008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:28.639183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9b863296-feec-48ab-97fa-c3d1646dc31d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 29738 microversion: 2.1 time: 0.118369 Jul 28 10:42:28.639793 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 434/848] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:28 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 29738 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:28.688643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:28.689281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:28.695125 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:28.695568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:28.696320 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:28.696769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:28.816072 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:28.829810 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:28.831314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:28.832449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7ada25e9-e670-43da-ae8e-7399cf77344b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.148305 Jul 28 10:42:28.833052 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 415/849] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:28 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:29.651292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:29.652293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:29.659423 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:29.659871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:29.660649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:29.661137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:29.760935 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-27bbfb59-49e7-4926-a280-8765de9b3b34 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 31509 microversion: 2.1 time: 0.113512 Jul 28 10:42:29.761594 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 435/850] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:29 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 31509 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:29.850232 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:29.850961 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:29.857545 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:29.857981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:29.858734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:29.859162 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:29.977290 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:29.985404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:29.986901 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:29.988062 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-df07897f-a7db-477f-b9a1-9878a40f9897 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.141423 Jul 28 10:42:29.988627 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 416/851] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:29 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:30.773605 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:30.774602 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:30.782365 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:30.782841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:30.783601 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:30.784031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:30.884182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2f25a5e6-303c-4c33-a28e-39fd4635f965 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 33141 microversion: 2.1 time: 0.114446 Jul 28 10:42:30.884844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 436/852] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:30 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 33141 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:31.006284 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:31.006806 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:31.013120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:31.013628 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:31.014386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:31.014820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:31.134690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:31.142830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:31.144307 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:31.145455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f4113d98-19a2-4843-b2dc-702fec1bcccc tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.142920 Jul 28 10:42:31.146015 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 417/853] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:31 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:31.896929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:31.897924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:31.905208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:31.905640 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:31.906405 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:31.906838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:32.004384 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-99e608ed-5a78-4271-9c37-cea0e770e2af tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 33929 microversion: 2.1 time: 0.111336 Jul 28 10:42:32.004956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 437/854] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:31 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 33929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:32.163541 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:32.164143 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:32.170420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:32.170862 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:32.171612 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:32.172039 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:32.288388 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:32.296580 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:32.298101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:32.299221 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2ccf8a4a-342d-4d98-9163-244842d4a9a2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.139351 Jul 28 10:42:32.299770 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 418/855] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:32 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:33.016624 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:33.017590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:33.023951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:33.024394 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:33.025181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:33.025611 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:33.114835 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d4171e2c-7ba9-4407-9266-aad9909e198b tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 35048 microversion: 2.1 time: 0.102248 Jul 28 10:42:33.115454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 438/856] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:33 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 35048 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:33.317623 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:33.318217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:33.324093 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:33.324537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:33.325851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:33.326286 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:33.441724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:33.449384 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:33.451379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:33.452508 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-66713065-d1a4-41d1-ad2e-d5f0362971b4 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.138623 Jul 28 10:42:33.453103 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 419/857] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:33 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:34.127874 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:34.128900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:34.135538 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:34.135986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:34.136764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:34.137201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:34.239511 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-136f86e9-8229-4b60-9048-80d046838a01 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 36552 microversion: 2.1 time: 0.115556 Jul 28 10:42:34.240126 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 439/858] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:34 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 36552 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:34.470412 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:34.471080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:34.476978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:34.477425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:34.478220 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:34.478655 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:34.599229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:34.606858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:34.608355 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:34.609517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5e17f44c-5b04-4750-a4fa-8a831b68ce93 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.142911 Jul 28 10:42:34.610077 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 420/859] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:34 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:35.252241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:35.253327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:35.259828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:35.260276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:35.261067 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:35.261515 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:35.359777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-baeb6457-c776-4bd7-9457-84849a49ec7a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 37967 microversion: 2.1 time: 0.111483 Jul 28 10:42:35.360403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 440/860] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:35 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 37967 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:35.627593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:35.628200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:35.633958 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:35.634403 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:35.635168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:35.635601 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:35.754624 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:35.762299 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:35.764283 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:35.765447 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b62a2654-abe4-4a97-9f62-78fff5bc7404 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.141531 Jul 28 10:42:35.766004 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 421/861] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:35 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:36.372175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:36.373252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:36.379724 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:36.380168 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:36.380961 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:36.381393 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:36.496259 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-df615b3c-eb64-4759-8457-da53616acbbb tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 38253 microversion: 2.1 time: 0.128188 Jul 28 10:42:36.497172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 441/862] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:36 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 38253 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:36.783451 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:36.784088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:36.789999 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:36.790441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:36.791190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:36.791620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:36.910453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:36.918134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:36.919611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:36.920982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-70cb7a32-fc52-49a5-a2d9-367a90347f4a tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.141287 Jul 28 10:42:36.921536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 422/863] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:36 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:37.508608 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:37.509638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:37.516180 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:37.516626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:37.517428 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:37.517855 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:37.605210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5fc86795-663e-4ceb-9fce-37d020806eb3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 38253 microversion: 2.1 time: 0.100518 Jul 28 10:42:37.606132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 442/864] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:37 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 38253 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:37.939188 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:37.939798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:37.945666 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:37.946110 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:37.946870 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:37.947334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:38.069984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:38.078611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:38.080063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:38.081229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4450d0af-f601-482b-abb5-901c41023aae tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.145918 Jul 28 10:42:38.081786 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 423/865] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:37 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:42:38.617166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:38.618153 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:38.625694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:38.626151 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:38.626924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:38.627362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:38.714232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8008d5d9-b3e1-4aa4-97db-8e04754cd645 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 38253 microversion: 2.1 time: 0.100967 Jul 28 10:42:38.714875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 443/866] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:38 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 38253 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:39.098596 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:39.099213 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:39.105522 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:39.105972 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:39.106738 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:39.107173 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:39.225021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:39.233190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:39.234660 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:39.235785 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-f930560c-bf60-49fb-a395-84c544e39dbe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1744 microversion: 2.20 time: 0.140873 Jul 28 10:42:39.236342 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 424/867] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:39 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1744 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:39.726761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:39.727755 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:39.735210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:39.735656 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:39.736431 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:39.736902 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:39.846578 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-01337eb6-f0ea-452e-8780-1ad9a1bb6cd4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action" status: 200 len: 38382 microversion: 2.1 time: 0.123690 Jul 28 10:42:39.847195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 444/868] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:42:39 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/action => generated 38382 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:39.856665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:39.857192 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:39.863909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:39.864353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:39.865152 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:39.865588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:39.888984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ebfc7e1c-31c1-4b42-82e2-4df797b090b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/ips" status: 200 len: 147 microversion: 2.1 time: 0.035629 Jul 28 10:42:39.889780 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 425/869] 10.222.0.25 () {58 vars in 1248 bytes} [Wed Jul 28 10:42:39 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:40.254938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:40.255556 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:40.262060 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:40.262505 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:40.263297 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:40.264297 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:40.385567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:40.394322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:40.395821 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:40.396991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-631677ab-8fba-4354-b271-4f4fa62dfb10 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1744 microversion: 2.20 time: 0.146217 Jul 28 10:42:40.397554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 445/870] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:40 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:41.212291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c676c98b-0b87-4dd7-98ff-9cd74f4283fd"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:41.213392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:41.221028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:41.221473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:41.222450 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:41.222930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:41.417922 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:41.419701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:41.427384 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:41.428177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:41.429242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:41.430228 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:41.573472 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e06959d0-bd5d-4068-8061-b0c6c6ff9ad3 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365922 Jul 28 10:42:41.579353 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 426/871] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:42:41 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:41.597717 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:41.607625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:41.610181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:41.611419 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a4a5f8e2-e40f-402c-a7f8-0ea9d4fff2d2 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.200038 Jul 28 10:42:41.612332 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 446/872] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:41 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:42.630690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:42.632041 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:42.639822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:42.640530 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:42.641616 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:42.642242 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:42.794820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:42.803992 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:42.805526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:42.806653 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0eb09d04-c416-48cd-901d-24a305f5f1a9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.180159 Jul 28 10:42:42.807200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 427/873] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:42 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:43.217468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-ed0b00c0-2185-4417-8a16-3c45608c6d38 req-a871f1df-5a9b-43cc-ad7c-c3b8bafd2c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "name": "network-vif-plugged", "status": "completed", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:43.219041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:42:43.219041 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:42:43.226565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-ed0b00c0-2185-4417-8a16-3c45608c6d38 req-a871f1df-5a9b-43cc-ad7c-c3b8bafd2c0d service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:43.227005 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-ed0b00c0-2185-4417-8a16-3c45608c6d38 req-a871f1df-5a9b-43cc-ad7c-c3b8bafd2c0d service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:43.247030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-ed0b00c0-2185-4417-8a16-3c45608c6d38 req-a871f1df-5a9b-43cc-ad7c-c3b8bafd2c0d service nova] Creating event network-vif-plugged:57f09889-bfea-4347-a33a-864b214d8f2c for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 on hv-cinder-80043 Jul 28 10:42:43.252667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-ed0b00c0-2185-4417-8a16-3c45608c6d38 req-a871f1df-5a9b-43cc-ad7c-c3b8bafd2c0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108551 Jul 28 10:42:43.253522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 447/874] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:43.824719 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:43.826622 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:43.832832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:43.833286 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:43.834234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:43.834667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:43.981603 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:43.991765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:43.994298 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:43.995523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-72d99833-661d-4628-af7e-9129477b8991 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.174537 Jul 28 10:42:43.996389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 428/875] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:43 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:45.016521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:45.017189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:45.025036 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:45.025702 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:45.026596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:45.027103 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:45.160159 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:45.168234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:45.170350 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:45.172113 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-eae7c5a5-dc29-45b0-885b-26796576fc32 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.160345 Jul 28 10:42:45.182638 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 448/876] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:45 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:46.190324 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:46.191033 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:46.197517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:46.197976 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:46.198773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:46.199216 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:46.332198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:46.341915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:46.345050 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:46.346189 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-393a1fb2-716f-4e0a-bb08-cef7e1286f38 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.159890 Jul 28 10:42:46.347267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 429/877] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:46 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:47.371460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:47.372329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:47.379647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:47.380096 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:47.381110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:47.381838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:47.507900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:47.515940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:47.517724 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:47.518870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2dec03e9-48fd-43f2-be4f-9dbda8f8e691 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.151439 Jul 28 10:42:47.519425 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 449/878] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:47 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:48.538526 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:48.539880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:48.546773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:48.547432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:48.548413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:48.548883 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:48.679930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:48.691835 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:48.693730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:48.697837 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6ac88f9c-23ba-4812-a672-bbc89078a6fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.162828 Jul 28 10:42:48.698476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 430/879] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:48 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:49.106374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:49.107871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:49.114318 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:49.114764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:49.115696 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:49.116233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:49.147755 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c0d35017-9337-43eb-9475-3d42fa7380a6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Jul 28 10:42:49.148719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 450/880] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Jul 28 10:42:49 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:49.158432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:49.158931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:49.164883 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:49.165331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:49.166105 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:49.166561 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:49.197390 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bf893e50-bf66-4da6-af66-83357004cfe1 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c676c98b-0b87-4dd7-98ff-9cd74f4283fd" status: 200 len: 194 microversion: 2.1 time: 0.042889 Jul 28 10:42:49.198495 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 431/881] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Jul 28 10:42:49 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c676c98b-0b87-4dd7-98ff-9cd74f4283fd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:49.716312 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:49.717674 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:49.723576 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:49.724029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:49.724899 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:49.725334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:49.854195 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:49.862191 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:49.863692 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:49.864844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-825a5260-4f07-43af-81cd-4774bcd226f7 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1739 microversion: 2.20 time: 0.152140 Jul 28 10:42:49.865400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 451/882] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:49 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:50.570423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c50fe37d-477b-4a9a-95b9-aa43e1d1d417"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:50.572063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:50.578554 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:50.579010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:50.579812 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:50.580245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:50.874101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0f267c56-a178-49a9-a68a-22f4d4230c04 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307218 Jul 28 10:42:50.874824 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 432/883] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:42:50 2021] POST /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:42:50.888942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:50.893338 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:50.900505 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:50.901212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:50.902155 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:50.903079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:51.051518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:51.062649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:51.064409 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:51.065898 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-882a812e-5035-49a8-8f1b-3a5010bbfe8f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1721 microversion: 2.20 time: 0.185244 Jul 28 10:42:51.066547 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 452/884] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:50 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:52.086224 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:52.086947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:52.094437 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:52.094886 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:52.095651 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:52.096087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:52.218312 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:52.225974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:52.227481 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:52.228610 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-831aaf20-5152-4a30-ae99-0a37d39d5a06 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1721 microversion: 2.20 time: 0.146441 Jul 28 10:42:52.229198 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 433/885] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:52 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:53.246337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:53.247197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:53.253828 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:53.254273 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:53.255034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:53.255479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:53.371292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:53.379944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:53.381495 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:53.382629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c047d977-3076-4712-8b28-012198e86a4f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1664 microversion: 2.20 time: 0.139984 Jul 28 10:42:53.383191 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 453/886] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:53 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1664 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:53.400476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1282b01-c5c4-4424-9b22-a36110edeeb5"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:53.401623 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:53.407660 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:53.408113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:53.408934 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:53.409381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:53.667538 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-792c9ba3-4693-4654-aef8-1833887cd4ee tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.270830 Jul 28 10:42:53.668145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 434/887] 10.222.0.25 () {62 vars in 1364 bytes} [Wed Jul 28 10:42:53 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/os-volume_attachments => generated 188 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 10:42:53.732141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:53.732729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:53.738531 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:53.738981 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:53.739751 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:53.740187 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:53.978542 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0d5e2394-5d7e-46e3-acb6-172f5a1fb790 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/os-volume_attachments/f1282b01-c5c4-4424-9b22-a36110edeeb5" status: 202 len: 0 microversion: 2.20 time: 0.250160 Jul 28 10:42:53.979128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 454/888] 10.222.0.25 () {60 vars in 1457 bytes} [Wed Jul 28 10:42:53 2021] DELETE /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/os-volume_attachments/f1282b01-c5c4-4424-9b22-a36110edeeb5 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:42:54.037178 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:54.037741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:54.044176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:54.044650 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:54.045517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:54.045951 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:54.119559 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0e99d747-9856-4ddd-893f-090f6d5aaee0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action" status: 202 len: 0 microversion: 2.20 time: 0.086012 Jul 28 10:42:54.120219 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 435/889] 10.222.0.25 () {62 vars in 1319 bytes} [Wed Jul 28 10:42:54 2021] POST /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:42:54.129509 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:54.130839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:54.136619 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:54.137197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:54.138037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:54.139172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:54.261750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:54.269694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:54.271169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:54.272288 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ee0bf110-5e63-46c5-b702-5c617c0b81b0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1672 microversion: 2.20 time: 0.146576 Jul 28 10:42:54.272910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 455/890] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:54 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:55.141775 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-9a8931a7-2bd3-480f-9db8-dace3887b3e5 req-6334c6ec-0faf-454d-8d0e-9f8b6068152a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "name": "network-vif-unplugged", "status": "completed", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:42:55.143449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:42:55.143449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:42:55.150692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-9a8931a7-2bd3-480f-9db8-dace3887b3e5 req-6334c6ec-0faf-454d-8d0e-9f8b6068152a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:55.151390 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-9a8931a7-2bd3-480f-9db8-dace3887b3e5 req-6334c6ec-0faf-454d-8d0e-9f8b6068152a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:55.167120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.compute.server_external_events [req-9a8931a7-2bd3-480f-9db8-dace3887b3e5 req-6334c6ec-0faf-454d-8d0e-9f8b6068152a service nova] Unable to find a host for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30. Dropping event network-vif-unplugged {{(pid=119121) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 28 10:42:55.168672 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-9a8931a7-2bd3-480f-9db8-dace3887b3e5 req-6334c6ec-0faf-454d-8d0e-9f8b6068152a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030935 Jul 28 10:42:55.170519 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 436/891] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 10:42:55.290169 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:55.290686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:55.296703 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:55.297173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:55.297929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:55.298361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:55.415861 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:55.424006 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:55.425544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:55.426684 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-25428730-61fd-4cf7-9e59-0ca6f7b99f94 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.140313 Jul 28 10:42:55.427251 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 456/892] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:55 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:56.445639 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:56.446980 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:56.453920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:56.454713 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:56.455730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:56.456395 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:56.586899 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:56.598211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:56.600347 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:56.601789 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8485d864-7c7c-40a1-b206-d1e314ea53fd tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.159852 Jul 28 10:42:56.602583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 437/893] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:56 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:57.622616 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:57.624639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:57.631856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:57.632322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:57.633115 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:57.633549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:57.758492 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:57.766470 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:57.768501 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:57.769884 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a8696932-ce37-4288-a9fc-3c76d364890e tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.152806 Jul 28 10:42:57.770759 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 457/894] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:57 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:58.789256 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:58.789880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:58.798081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:58.798881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:58.800238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:58.801179 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:58.930129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:58.938023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:58.939520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:42:58.940676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-03a8d976-44f4-474e-85fb-06afe868c42d tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.155502 Jul 28 10:42:58.941253 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 438/895] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:58 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:42:59.959436 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:42:59.960114 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:42:59.966761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:59.967327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:42:59.968217 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:42:59.968683 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:00.099107 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:00.107640 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:00.109687 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:00.112033 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a1537aa2-baa2-4ac3-b3f3-0a06f59ab903 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.155334 Jul 28 10:43:00.121294 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 458/896] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:42:59 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:01.133053 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:01.135257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:01.145124 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:01.146098 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:01.147177 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:01.147696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:01.277250 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:01.285372 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:01.286851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:01.287974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-31f0f52b-e243-4531-8cb9-93b028e9a3b5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.160075 Jul 28 10:43:01.288538 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 439/897] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:01 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:02.308458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:02.309306 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:02.316334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:02.316706 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:02.317517 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:02.317954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:02.444441 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:02.452805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:02.454293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:02.455411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2cdfa89f-99f7-4245-bbc8-76a1a1a71ee9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.151806 Jul 28 10:43:02.455980 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 459/898] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:02 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:03.474632 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:03.475230 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:03.481134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:03.481581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:03.482345 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:03.482776 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:03.605279 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:03.613095 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:03.614584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:03.615698 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-204bf294-5977-4b76-8a8f-9ffd881bad42 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.144807 Jul 28 10:43:03.616236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 440/899] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:03 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:04.635225 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:04.636641 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:04.643343 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:04.643789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:04.644569 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:04.645028 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:04.777401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:04.786044 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:04.787523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:04.788639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-90864381-bb93-4b9c-b96f-4a161d66e624 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.157762 Jul 28 10:43:04.789227 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 460/900] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:04 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:05.807062 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:05.807681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:05.814058 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:05.814496 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:05.815249 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:05.815679 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:05.942035 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:05.951189 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:05.952949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:05.954884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4ddd1b8b-4b3e-4204-9ba2-cb6e6076d3f0 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.151526 Jul 28 10:43:05.955451 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 441/901] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:05 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:06.973537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:06.974112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:06.981219 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:06.981794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:06.982652 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:06.983172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:07.105906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:07.114356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:07.115859 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:07.117056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5b65c70f-8242-438c-aa44-b376ee4fc8c5 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.148439 Jul 28 10:43:07.117618 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 461/902] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:06 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:08.135799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:08.136402 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:08.143313 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:08.143753 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:08.144501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:08.144966 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:08.264769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:08.273206 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:08.274700 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:08.275822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d578d3d5-296d-4527-9460-7b79363ac97f tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.143664 Jul 28 10:43:08.276370 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 442/903] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:08 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:08.959992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:08.961247 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:08.967014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:08.967457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:08.968213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:08.968639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:08.998277 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5918aed4-ce2f-4c6b-8e66-dfa38e70a294 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041985 Jul 28 10:43:08.998818 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 462/904] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Jul 28 10:43:08 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:43:09.227892 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:09.228432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:09.234172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:09.234620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:09.237328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:09.237766 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:09.266810 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4bfd8c29-08ce-47b9-af41-0406bf3b19a4 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c676c98b-0b87-4dd7-98ff-9cd74f4283fd" status: 200 len: 194 microversion: 2.1 time: 0.042799 Jul 28 10:43:09.267405 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 443/905] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Jul 28 10:43:09 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c676c98b-0b87-4dd7-98ff-9cd74f4283fd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:43:09.277694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:09.278185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:09.283931 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:09.284373 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:09.285172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:09.285599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:09.293486 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:09.294098 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:09.300414 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:09.300887 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:09.301652 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:09.302086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:09.368279 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lazy-loading 'services' on Instance uuid d99d7091-6a64-45bd-83fe-050332612e8b {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:43:09.423873 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:09.432635 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:09.434217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:09.434633 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6895d4d4-f1bf-4994-8bfd-79a8b78fa10e tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c676c98b-0b87-4dd7-98ff-9cd74f4283fd" status: 202 len: 0 microversion: 2.1 time: 0.160536 Jul 28 10:43:09.435459 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 463/906] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:43:09 2021] DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c676c98b-0b87-4dd7-98ff-9cd74f4283fd => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:43:09.435582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-59f280a7-53e9-47fa-9592-cf38a8215003 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.145532 Jul 28 10:43:09.435890 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 444/907] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:09 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 10:43:10.454696 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:10.455316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:10.461374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:10.461809 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:10.462562 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:10.462987 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:10.562226 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:10.563448 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:10.571504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:10.572165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:10.573260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:10.573705 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:10.600861 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:10.609148 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:10.611356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:10.612335 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7c49acc1-0725-4e7b-b975-7f0b4dbe39c5 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c50fe37d-477b-4a9a-95b9-aa43e1d1d417" status: 200 len: 194 microversion: 2.1 time: 0.053839 Jul 28 10:43:10.612668 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-282c19cd-3c66-4032-be15-0d98959577ed tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.163051 Jul 28 10:43:10.613116 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 445/908] 10.222.0.25 () {58 vars in 1413 bytes} [Wed Jul 28 10:43:10 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c50fe37d-477b-4a9a-95b9-aa43e1d1d417 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:43:10.613733 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 464/909] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:10 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:10.626826 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:10.627432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:10.633532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:10.633981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:10.634753 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:10.635193 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:10.716622 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lazy-loading 'services' on Instance uuid d99d7091-6a64-45bd-83fe-050332612e8b {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:43:10.778794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bc4d7ae9-9b5e-45f6-ba0a-41696ea73b86 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c50fe37d-477b-4a9a-95b9-aa43e1d1d417" status: 202 len: 0 microversion: 2.1 time: 0.156521 Jul 28 10:43:10.779444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 446/910] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:43:10 2021] DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b/os-volume_attachments/c50fe37d-477b-4a9a-95b9-aa43e1d1d417 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:43:11.631465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:11.632111 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:11.638313 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:11.638750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:11.639524 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:11.639951 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:11.762925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:11.771598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:11.773205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:11.774340 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c4a1b36f-48b4-48bf-8e06-540f1067e763 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.146712 Jul 28 10:43:11.774906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 465/911] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:11 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:12.095512 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:12.096088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:12.102038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:12.102480 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:12.103231 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:12.103662 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:12.128800 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:43:12.200408 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-acaa8498-266f-4d9e-8c31-6f873201ba78 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 204 len: 0 microversion: 2.1 time: 0.108470 Jul 28 10:43:12.200971 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 447/912] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:43:12 2021] DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:43:12.209513 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:12.210122 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:12.215797 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:12.216242 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:12.217033 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:12.217466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:12.338851 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:12.346285 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d5b37b53-be43-44f7-98d6-287be7f26c8d tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1673 microversion: 2.1 time: 0.140616 Jul 28 10:43:12.346885 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 466/913] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:12 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1673 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:43:12.793091 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:12.793787 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:12.800273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:12.800721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:12.801508 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:12.801949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:12.919551 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:12.927872 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:12.929421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:12.930557 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-89460ca8-9a05-4085-8da1-9d5524839722 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.141628 Jul 28 10:43:12.931113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 448/914] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:12 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:13.215824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-e452c8f2-f258-4769-b3e6-9222cab61f9f req-dd98e16f-f864-4f92-a79f-8c832ccd77e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "name": "network-vif-plugged", "status": "completed", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:13.217581 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:43:13.217581 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:43:13.225002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-e452c8f2-f258-4769-b3e6-9222cab61f9f req-dd98e16f-f864-4f92-a79f-8c832ccd77e4 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:13.225544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-e452c8f2-f258-4769-b3e6-9222cab61f9f req-dd98e16f-f864-4f92-a79f-8c832ccd77e4 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:13.238777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-e452c8f2-f258-4769-b3e6-9222cab61f9f req-dd98e16f-f864-4f92-a79f-8c832ccd77e4 service nova] Creating event network-vif-plugged:57f09889-bfea-4347-a33a-864b214d8f2c for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 on hv-cinder-80043 Jul 28 10:43:13.243430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-e452c8f2-f258-4769-b3e6-9222cab61f9f req-dd98e16f-f864-4f92-a79f-8c832ccd77e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031203 Jul 28 10:43:13.244016 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 467/915] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:43:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:43:13.363334 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:13.363942 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:13.369727 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:13.370183 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:13.370944 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:13.371387 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:13.496122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:13.504167 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-23a02733-402f-4e59-9c82-85517fa8b9e2 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1673 microversion: 2.1 time: 0.144417 Jul 28 10:43:13.504741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 449/916] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:13 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:13.949477 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:13.950103 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:13.957158 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:13.957604 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:13.958364 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:13.958798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:14.080045 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:14.087878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:14.089421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:14.090556 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5836bf35-5021-43c2-8fac-67b8ba2ecfd1 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.145739 Jul 28 10:43:14.091110 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 468/917] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:13 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:14.521941 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:14.522547 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:14.528301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:14.528907 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:14.529671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:14.530103 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:14.667800 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:14.675411 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-301701fb-3e18-4747-b9f5-28e07b712a7c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1673 microversion: 2.1 time: 0.157224 Jul 28 10:43:14.676102 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 450/918] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:14 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:15.108948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:15.110119 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:15.116230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:15.116673 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:15.117479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:15.117906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:15.591292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:15.600377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:15.601848 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:15.603770 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9bb89130-c352-4aac-bd16-c8d48658e5fe tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1730 microversion: 2.20 time: 0.498554 Jul 28 10:43:15.611838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 469/919] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:15 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1730 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:15.671021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-ec628121-d24d-45e1-96cc-ac9a9ecd95e6 req-cc54247c-e97e-43bb-9c99-64705134a7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99d7091-6a64-45bd-83fe-050332612e8b", "name": "network-vif-deleted", "tag": "26a3b716-ff5a-4338-a882-aad89e4ed3d7"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:15.673153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:43:15.673153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:43:15.680389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-ec628121-d24d-45e1-96cc-ac9a9ecd95e6 req-cc54247c-e97e-43bb-9c99-64705134a7b9 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:15.680863 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-ec628121-d24d-45e1-96cc-ac9a9ecd95e6 req-cc54247c-e97e-43bb-9c99-64705134a7b9 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:15.692225 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-ec628121-d24d-45e1-96cc-ac9a9ecd95e6 req-cc54247c-e97e-43bb-9c99-64705134a7b9 service nova] Creating event network-vif-deleted:26a3b716-ff5a-4338-a882-aad89e4ed3d7 for instance d99d7091-6a64-45bd-83fe-050332612e8b on hv-cinder-80043 Jul 28 10:43:15.692448 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:15.692915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:15.697039 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-ec628121-d24d-45e1-96cc-ac9a9ecd95e6 req-cc54247c-e97e-43bb-9c99-64705134a7b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083934 Jul 28 10:43:15.697682 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 451/920] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:43:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:43:15.700986 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:15.701444 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:15.702233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:15.702672 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:15.765881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b1261478f8499da914a9b8162a54e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f97a7ceb6d4d14928726470b026565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:15.773697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-86b79a3c-27f0-41f6-918e-e3c11192007a tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 200 len: 1321 microversion: 2.1 time: 0.085225 Jul 28 10:43:15.774268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 470/921] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:15 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 1321 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:43:16.623597 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:16.624302 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:16.631267 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:16.631722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:16.632493 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:16.632974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:16.751789 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:16.759517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:16.761020 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:16.762135 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ce3e4619-b0a9-494d-acdd-11481b5304f8 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1717 microversion: 2.20 time: 0.143062 Jul 28 10:43:16.762701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 452/922] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:16 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1717 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:16.790808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:16.791419 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:16.797755 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:16.798200 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:16.798956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:16.799386 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:16.812276 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] HTTP exception thrown: Instance d99d7091-6a64-45bd-83fe-050332612e8b could not be found. Jul 28 10:43:16.813445 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Returning 404 to user: Instance d99d7091-6a64-45bd-83fe-050332612e8b could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:16.814247 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b373b8ee-4674-4389-aaca-edd9ffd1b004 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 404 len: 111 microversion: 2.1 time: 0.027154 Jul 28 10:43:16.814760 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 471/923] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:16 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:16.822562 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5584519f-ede4-4f47-b7a7-8691b226f52c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '.version_select at 0x7fe4776a7670>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:16.839422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5584519f-ede4-4f47-b7a7-8691b226f52c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664296924" status: 202 len: 0 microversion: 2.1 time: 0.020324 Jul 28 10:43:16.839896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 453/924] 10.222.0.25 () {58 vars in 1218 bytes} [Wed Jul 28 10:43:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664296924 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:43:19.689942 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:19.690466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:19.696267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:19.696711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:19.697506 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:19.697940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:19.711351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] HTTP exception thrown: Instance d99d7091-6a64-45bd-83fe-050332612e8b could not be found. Jul 28 10:43:19.711937 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Returning 404 to user: Instance d99d7091-6a64-45bd-83fe-050332612e8b could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:19.712771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a2fc13e7-441b-4480-b14e-d98edfbb1394 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 404 len: 111 microversion: 2.1 time: 0.026641 Jul 28 10:43:19.713303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 472/925] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:43:19 2021] DELETE /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:19.722036 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:19.722644 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: d99d7091-6a64-45bd-83fe-050332612e8b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:19.728516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:19.728996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:19.729751 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:19.730179 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:19.743438 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] HTTP exception thrown: Instance d99d7091-6a64-45bd-83fe-050332612e8b could not be found. Jul 28 10:43:19.744006 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Returning 404 to user: Instance d99d7091-6a64-45bd-83fe-050332612e8b could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:19.744863 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c4283672-0b93-4064-b72d-e66d2dbcc70c tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b" status: 404 len: 111 microversion: 2.1 time: 0.027511 Jul 28 10:43:19.745369 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 454/926] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:19 2021] GET /compute/v2.1/servers/d99d7091-6a64-45bd-83fe-050332612e8b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:20.875789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:20.876254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:20.882411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:20.882856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:20.883629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:20.884061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:20.897233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] HTTP exception thrown: Instance 1075c593-6301-4ed9-b795-78c416194982 could not be found. Jul 28 10:43:20.897811 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Returning 404 to user: Instance 1075c593-6301-4ed9-b795-78c416194982 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:20.898629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-532cb95a-e190-4e4b-b4b4-df3af5158d96 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 404 len: 111 microversion: 2.1 time: 0.027361 Jul 28 10:43:20.899159 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 473/927] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:43:20 2021] DELETE /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:20.907588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:20.908208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] [instance: 1075c593-6301-4ed9-b795-78c416194982] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:20.914025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:20.915037 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:20.915984 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:20.916424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:20.930573 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] HTTP exception thrown: Instance 1075c593-6301-4ed9-b795-78c416194982 could not be found. Jul 28 10:43:20.931161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] Returning 404 to user: Instance 1075c593-6301-4ed9-b795-78c416194982 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:20.931998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d8e6621d-a963-4df9-8fd6-844e667587b6 tempest-AttachVolumeTestJSON-1703114434 tempest-AttachVolumeTestJSON-1703114434-project] 10.222.0.25 "GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982" status: 404 len: 111 microversion: 2.1 time: 0.028802 Jul 28 10:43:20.932531 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 455/928] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:20 2021] GET /compute/v2.1/servers/1075c593-6301-4ed9-b795-78c416194982 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:38.300989 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:38.301674 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:38.308507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:38.308952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:38.310050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:38.319385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:38.346885 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:43:38.459133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4dd26764-389e-46e2-82d0-6f70bc5a686c tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 204 len: 0 microversion: 2.1 time: 0.161591 Jul 28 10:43:38.459805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 474/929] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:43:38 2021] DELETE /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:43:38.472435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-5d4098d3-843b-495b-8292-a8911f3448d3 req-a20d11c1-9933-44ab-b848-eb05911f5015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:38.474073 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:43:38.474073 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:43:38.479272 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:38.480396 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:38.481028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-5d4098d3-843b-495b-8292-a8911f3448d3 req-a20d11c1-9933-44ab-b848-eb05911f5015 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:38.481490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-5d4098d3-843b-495b-8292-a8911f3448d3 req-a20d11c1-9933-44ab-b848-eb05911f5015 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:38.488674 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:38.489625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:38.490737 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:38.492459 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:38.492721 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-5d4098d3-843b-495b-8292-a8911f3448d3 req-a20d11c1-9933-44ab-b848-eb05911f5015 service nova] Creating event network-changed:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:43:38.498647 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-5d4098d3-843b-495b-8292-a8911f3448d3 req-a20d11c1-9933-44ab-b848-eb05911f5015 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194661 Jul 28 10:43:38.499760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 456/930] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:43:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:43:38.710243 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:38.716881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c56d05eb-f8da-4bd4-b21b-20cc0234172d tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1570 microversion: 2.1 time: 0.252465 Jul 28 10:43:38.717722 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 475/931] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:38 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1570 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:43:39.734879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:39.736386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:39.742377 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:39.742879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:39.743657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:39.744089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:39.864866 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:39.872471 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6acc397f-ff76-4db2-a0a3-6399e6b8b5e9 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1452 microversion: 2.1 time: 0.141511 Jul 28 10:43:39.873287 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 457/932] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:39 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:40.730960 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-6d25439c-4ccd-439a-bcd0-a435c7915c79 req-287ad066-2b87-4626-9d6a-500899f5279c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05f242-2582-45fb-8d05-c98f329b76e0", "name": "network-vif-deleted", "tag": "e8c0eb84-933d-4aff-bd40-7c0eb90d9d74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:40.732636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:43:40.732636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:43:40.740329 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-6d25439c-4ccd-439a-bcd0-a435c7915c79 req-287ad066-2b87-4626-9d6a-500899f5279c service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:40.740878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-6d25439c-4ccd-439a-bcd0-a435c7915c79 req-287ad066-2b87-4626-9d6a-500899f5279c service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:40.752689 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-6d25439c-4ccd-439a-bcd0-a435c7915c79 req-287ad066-2b87-4626-9d6a-500899f5279c service nova] Creating event network-vif-deleted:e8c0eb84-933d-4aff-bd40-7c0eb90d9d74 for instance fe05f242-2582-45fb-8d05-c98f329b76e0 on hv-cinder-80043 Jul 28 10:43:40.758013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-6d25439c-4ccd-439a-bcd0-a435c7915c79 req-287ad066-2b87-4626-9d6a-500899f5279c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030868 Jul 28 10:43:40.758838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 476/933] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:43:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:43:40.889476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:40.890089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:40.896019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:40.896472 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:40.897280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:40.897716 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:40.965600 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f6c76e08d7451c925dfb6654ff0031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a445a74e104a019c3d28d3f69fa4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:40.973786 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ce43357b-a771-4b11-9638-a7f756933b07 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 200 len: 1220 microversion: 2.1 time: 0.087980 Jul 28 10:43:40.974391 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 458/934] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:40 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:43:41.990990 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:41.991693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] [instance: fe05f242-2582-45fb-8d05-c98f329b76e0] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:41.997954 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:41.998401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:41.999165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:41.999600 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:42.015606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] HTTP exception thrown: Instance fe05f242-2582-45fb-8d05-c98f329b76e0 could not be found. Jul 28 10:43:42.015606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Returning 404 to user: Instance fe05f242-2582-45fb-8d05-c98f329b76e0 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:42.015606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-467f02e9-0703-47bc-9631-56c946a766f1 tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0" status: 404 len: 111 microversion: 2.1 time: 0.028019 Jul 28 10:43:42.015606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 477/935] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:41 2021] GET /compute/v2.1/servers/fe05f242-2582-45fb-8d05-c98f329b76e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:42.175544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-03c058f1-8d25-4af8-952e-8ba7d5c669be tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] Calling method '.version_select at 0x7fe47ca994c0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:42.195101 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-03c058f1-8d25-4af8-952e-8ba7d5c669be tempest-TestShelveInstance-1510967925 tempest-TestShelveInstance-1510967925-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018612799" status: 202 len: 0 microversion: 2.1 time: 0.023968 Jul 28 10:43:42.195831 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 459/936] 10.222.0.25 () {58 vars in 1254 bytes} [Wed Jul 28 10:43:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018612799 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:43:49.980174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:49.980808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:49.986763 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:49.987206 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:49.987964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:49.988394 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:50.014528 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:43:50.087357 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4b4adec8-1c9e-48e0-92dd-a0c22b889d34 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 204 len: 0 microversion: 2.20 time: 0.110731 Jul 28 10:43:50.088023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 478/937] 10.222.0.25 () {60 vars in 1280 bytes} [Wed Jul 28 10:43:49 2021] DELETE /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:43:50.097496 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:50.098663 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:50.105261 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:50.105736 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:50.106582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:50.107039 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:50.238772 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:50.247172 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:50.248666 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:50.249843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a1876ab8-3fcd-4681-a2d0-80080a218274 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.156941 Jul 28 10:43:50.250393 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 460/938] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:50 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:51.269679 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:51.270377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:51.276199 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:51.276643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:51.277438 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:51.277868 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:51.414780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:51.422561 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:51.424549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:51.425690 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a03e0ee1-989d-49cb-958b-dcd9779bc725 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1723 microversion: 2.20 time: 0.160606 Jul 28 10:43:51.426240 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 479/939] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:51 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:52.444022 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:52.444728 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:52.453160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:52.453160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:52.453160 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:52.454525 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:52.479966 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-7230f1e6-1e3a-4452-839e-47913d6d8796 req-59fbafc7-586c-4b5d-aee1-5e05ddfa55ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0745fdb0-bc0e-4283-9eaf-21f586727c30", "name": "network-vif-deleted", "tag": "57f09889-bfea-4347-a33a-864b214d8f2c"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:43:52.482196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:43:52.482196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:43:52.491310 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-7230f1e6-1e3a-4452-839e-47913d6d8796 req-59fbafc7-586c-4b5d-aee1-5e05ddfa55ca service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:52.491761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-7230f1e6-1e3a-4452-839e-47913d6d8796 req-59fbafc7-586c-4b5d-aee1-5e05ddfa55ca service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:52.505153 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-7230f1e6-1e3a-4452-839e-47913d6d8796 req-59fbafc7-586c-4b5d-aee1-5e05ddfa55ca service nova] Creating event network-vif-deleted:57f09889-bfea-4347-a33a-864b214d8f2c for instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 on hv-cinder-80043 Jul 28 10:43:52.510540 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-7230f1e6-1e3a-4452-839e-47913d6d8796 req-59fbafc7-586c-4b5d-aee1-5e05ddfa55ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034314 Jul 28 10:43:52.511697 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 480/940] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:43:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:43:52.528012 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:52.536976 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:52.538899 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9de460033b7846bfa2d49e86936e4b68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b9f9b1967a4b24a6ca58290fb2179b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:43:52.540289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b069fad0-b042-4dfa-b131-6b5091850462 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 200 len: 1655 microversion: 2.20 time: 0.100023 Jul 28 10:43:52.541421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 461/941] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:52 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 10:43:53.563538 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:53.566307 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:53.573932 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:53.574857 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:53.575827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:53.576328 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:53.593184 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] HTTP exception thrown: Instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 could not be found. Jul 28 10:43:53.594210 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Returning 404 to user: Instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:53.596586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ef60146e-80ef-443d-9d15-f959412d3503 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 404 len: 111 microversion: 2.20 time: 0.038044 Jul 28 10:43:53.601274 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 481/942] 10.222.0.25 () {60 vars in 1277 bytes} [Wed Jul 28 10:43:53 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 10:43:53.607039 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-123d46c6-0718-4f6a-9391-dba2b8616cac tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '.version_select at 0x7fe4776ed5e0>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:53.625768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-123d46c6-0718-4f6a-9391-dba2b8616cac tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037778937" status: 204 len: 0 microversion: 2.20 time: 0.022387 Jul 28 10:43:53.626378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 462/943] 10.222.0.25 () {60 vars in 1262 bytes} [Wed Jul 28 10:43:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037778937 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 10:43:55.459185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:55.459682 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:55.465485 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:55.465933 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:55.466700 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:55.467135 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:55.480097 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] HTTP exception thrown: Instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 could not be found. Jul 28 10:43:55.480694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Returning 404 to user: Instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:55.481535 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-b0e22ad4-0183-4f3d-8db8-7f2b84b98d63 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 404 len: 111 microversion: 2.1 time: 0.026574 Jul 28 10:43:55.482055 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 482/944] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:43:55 2021] DELETE /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 10:43:55.489620 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:55.490265 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: 0745fdb0-bc0e-4283-9eaf-21f586727c30] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:55.495993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:55.496441 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:55.497482 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:55.497916 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:55.511444 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] HTTP exception thrown: Instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 could not be found. Jul 28 10:43:55.512019 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Returning 404 to user: Instance 0745fdb0-bc0e-4283-9eaf-21f586727c30 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:55.512856 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-248212e5-18bc-43e8-933d-624ec014f42b tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30" status: 404 len: 111 microversion: 2.1 time: 0.026858 Jul 28 10:43:55.513363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 463/945] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:55 2021] GET /compute/v2.1/servers/0745fdb0-bc0e-4283-9eaf-21f586727c30 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:56.641662 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:56.642691 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:56.648524 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:56.649008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:56.649820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:56.650237 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:56.663777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] HTTP exception thrown: Instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b could not be found. Jul 28 10:43:56.664347 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Returning 404 to user: Instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:56.665215 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c2618026-d836-443b-af75-f5bb0d124ba9 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "DELETE /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 404 len: 111 microversion: 2.1 time: 0.027200 Jul 28 10:43:56.665725 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 483/946] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:43:56 2021] DELETE /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:43:56.673220 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:43:56.674252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] [instance: cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:43:56.680186 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:56.680640 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:56.681476 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:43:56.681902 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:43:56.695817 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] HTTP exception thrown: Instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b could not be found. Jul 28 10:43:56.696439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] Returning 404 to user: Instance cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:43:56.697306 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8ae4a313-1b68-4b81-8427-272378846db6 tempest-AttachVolumeShelveTestJSON-1502420471 tempest-AttachVolumeShelveTestJSON-1502420471-project] 10.222.0.25 "GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b" status: 404 len: 111 microversion: 2.1 time: 0.027707 Jul 28 10:43:56.697842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 464/947] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:43:56 2021] GET /compute/v2.1/servers/cb15fb4f-4ab3-46ff-8a51-9cbc4cc9ce4b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:44:20.546458 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1371127773", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:20.602342 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] validate_networks() for None {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:44:20.882381 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:44:20.882808 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:44:20.883305 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:44:20.883701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:44:20.884117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:44:20.893442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:20.893883 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:20.894681 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:20.895115 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:20.911113 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Getting quotas for project dce3758e02e54dd681359ecf27233b0e. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:44:20.914924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Getting quotas for user 816ee0486f334a03ba83a5fc29433031 and project dce3758e02e54dd681359ecf27233b0e. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:44:20.925586 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:44:20.927869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:44:20.974271 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3f230305-cebe-494c-bb60-c06cfcd578d7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.431448 Jul 28 10:44:20.974959 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 484/948] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:44:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:44:20.985917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5adc177b-dc5b-463a-9da4-e5550bc2bf5f tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:20.986714 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5adc177b-dc5b-463a-9da4-e5550bc2bf5f tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:21.039248 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5adc177b-dc5b-463a-9da4-e5550bc2bf5f tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:21.045591 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5adc177b-dc5b-463a-9da4-e5550bc2bf5f tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1215 microversion: 2.1 time: 0.064520 Jul 28 10:44:21.046144 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 465/949] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:20 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:22.064964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:22.065702 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:22.072154 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:22.073106 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:22.074103 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:22.074709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:22.423356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:22.431425 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-149a40b0-fd6c-4b10-9758-28f9aedc0f07 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1273 microversion: 2.1 time: 0.370403 Jul 28 10:44:22.431996 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 485/950] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:22 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:23.451646 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:23.452217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:23.459052 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:23.459501 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:23.460316 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:23.460768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:23.597372 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:23.616991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-356f43b7-7521-496f-9792-855a630f292b tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1315 microversion: 2.1 time: 0.170188 Jul 28 10:44:23.617570 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 466/951] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:23 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:23.755671 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-eb420029-1c80-4fc2-8013-8b340d528dea req-4399b1a2-87de-433f-9443-87ab934eaf8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37911f69-fd30-484c-90b4-9cd552c97384", "tag": "3a355e2b-1a09-41e5-a4eb-7fb3c43a8ddb"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:23.757389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:44:23.757389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:44:23.766461 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-eb420029-1c80-4fc2-8013-8b340d528dea req-4399b1a2-87de-433f-9443-87ab934eaf8e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:23.766982 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-eb420029-1c80-4fc2-8013-8b340d528dea req-4399b1a2-87de-433f-9443-87ab934eaf8e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:23.780201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-eb420029-1c80-4fc2-8013-8b340d528dea req-4399b1a2-87de-433f-9443-87ab934eaf8e service nova] Creating event network-changed:3a355e2b-1a09-41e5-a4eb-7fb3c43a8ddb for instance 37911f69-fd30-484c-90b4-9cd552c97384 on hv-cinder-80043 Jul 28 10:44:23.794170 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-eb420029-1c80-4fc2-8013-8b340d528dea req-4399b1a2-87de-433f-9443-87ab934eaf8e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044503 Jul 28 10:44:23.794780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 486/952] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:44:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:44:24.634289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:24.634982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:24.641190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:24.641651 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:24.642437 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:24.642878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:24.771415 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:24.778665 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-85692c04-b7ee-4c0d-b0c8-d0280a0446e8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1315 microversion: 2.1 time: 0.148113 Jul 28 10:44:24.779908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 467/953] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:24 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:25.796967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:25.797663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:25.803761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:25.804205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:25.804997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:25.805429 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:25.928014 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:25.935208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6ae67fd0-9e41-4035-abf2-0c8a391baeb7 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1315 microversion: 2.1 time: 0.142571 Jul 28 10:44:25.935765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 487/954] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:25 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:26.952352 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:26.954887 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:26.962080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:26.962524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:26.963300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:26.963768 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:27.088007 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:27.095277 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-67ba476a-2798-4c38-b4ce-23a441b79768 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1315 microversion: 2.1 time: 0.146647 Jul 28 10:44:27.095847 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 468/955] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:26 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:28.111537 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:28.112136 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:28.118335 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:28.118775 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:28.119527 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:28.119953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:28.239993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:28.247546 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-400ab934-c264-4c1c-bdf0-476907112da6 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1315 microversion: 2.1 time: 0.139828 Jul 28 10:44:28.248141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 488/956] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:28 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:28.315788 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-a999a32d-80c9-4730-a082-f16ca4b1b5a9 req-7da77d3b-e57a-48b2-83e9-d4b8d8e58058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37911f69-fd30-484c-90b4-9cd552c97384", "name": "network-vif-plugged", "status": "completed", "tag": "3a355e2b-1a09-41e5-a4eb-7fb3c43a8ddb"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:28.317439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:44:28.317439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:44:28.324920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-a999a32d-80c9-4730-a082-f16ca4b1b5a9 req-7da77d3b-e57a-48b2-83e9-d4b8d8e58058 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:28.325432 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-a999a32d-80c9-4730-a082-f16ca4b1b5a9 req-7da77d3b-e57a-48b2-83e9-d4b8d8e58058 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:28.337461 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-a999a32d-80c9-4730-a082-f16ca4b1b5a9 req-7da77d3b-e57a-48b2-83e9-d4b8d8e58058 service nova] Creating event network-vif-plugged:3a355e2b-1a09-41e5-a4eb-7fb3c43a8ddb for instance 37911f69-fd30-484c-90b4-9cd552c97384 on hv-cinder-80043 Jul 28 10:44:28.342223 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-a999a32d-80c9-4730-a082-f16ca4b1b5a9 req-7da77d3b-e57a-48b2-83e9-d4b8d8e58058 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030684 Jul 28 10:44:28.342876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 469/957] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:44:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:44:29.264364 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:29.265025 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:29.270941 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:29.271385 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:29.272140 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:29.272571 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:29.394027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:29.401160 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-069d32ed-4fe8-4940-b994-3944be477741 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1315 microversion: 2.1 time: 0.140439 Jul 28 10:44:29.401719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 489/958] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:29 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:30.419930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:30.420535 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:30.426880 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:30.427402 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:30.428164 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:30.428594 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:30.547947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:30.555473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-80a1dc5f-1f64-4370-86f1-7075fb64d6a8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1465 microversion: 2.1 time: 0.139711 Jul 28 10:44:30.556026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 470/959] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:30 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1465 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:30.592417 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:30.592963 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:30.598840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:30.599287 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:30.600052 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:30.600485 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:30.624451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:44:30.701414 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3124b309-997e-4316-89fc-e31408e7fa6c tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "DELETE /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 204 len: 0 microversion: 2.1 time: 0.112200 Jul 28 10:44:30.702120 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 490/960] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:44:30 2021] DELETE /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:44:30.712054 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:30.712669 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:30.718599 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:30.719045 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:30.719839 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:30.720270 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:30.841922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:30.849549 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7b0231ac-edd7-4618-8adf-f2f36ca564c8 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1471 microversion: 2.1 time: 0.141768 Jul 28 10:44:30.850120 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 471/961] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:30 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:31.867239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:31.867973 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:31.874117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:31.874559 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:31.875320 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:31.875750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:31.995294 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:32.003863 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d7106e3e-1f3d-4061-b4f6-a8f34a7941df tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1471 microversion: 2.1 time: 0.140649 Jul 28 10:44:32.004438 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 491/962] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:31 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1471 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:32.734930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-e478f3fb-d406-413d-a1d3-6b0401b0730b req-f8543e34-20b6-4494-a9c2-6f214d6a5114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37911f69-fd30-484c-90b4-9cd552c97384", "name": "network-vif-deleted", "tag": "3a355e2b-1a09-41e5-a4eb-7fb3c43a8ddb"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:32.736636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:44:32.736636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:44:32.745079 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-e478f3fb-d406-413d-a1d3-6b0401b0730b req-f8543e34-20b6-4494-a9c2-6f214d6a5114 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:32.745516 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-e478f3fb-d406-413d-a1d3-6b0401b0730b req-f8543e34-20b6-4494-a9c2-6f214d6a5114 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:32.762031 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-e478f3fb-d406-413d-a1d3-6b0401b0730b req-f8543e34-20b6-4494-a9c2-6f214d6a5114 service nova] Creating event network-vif-deleted:3a355e2b-1a09-41e5-a4eb-7fb3c43a8ddb for instance 37911f69-fd30-484c-90b4-9cd552c97384 on hv-cinder-80043 Jul 28 10:44:32.767487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-e478f3fb-d406-413d-a1d3-6b0401b0730b req-f8543e34-20b6-4494-a9c2-6f214d6a5114 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036134 Jul 28 10:44:32.768125 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 472/963] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:44:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:44:33.021412 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:33.021929 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:33.027756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:33.028196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:33.028993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:33.029421 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:33.059609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:33.060054 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:33.060498 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lazy-loading 'fault' on Instance uuid 37911f69-fd30-484c-90b4-9cd552c97384 {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:44:33.099720 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816ee0486f334a03ba83a5fc29433031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce3758e02e54dd681359ecf27233b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:33.106915 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a76328a3-17d0-44ba-8167-92b656ae3bae tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 200 len: 1305 microversion: 2.1 time: 0.089933 Jul 28 10:44:33.107466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 492/964] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:33 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:34.125108 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:34.125664 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] [instance: 37911f69-fd30-484c-90b4-9cd552c97384] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:34.132155 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:34.132604 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:34.133389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:34.133825 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:34.147260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] HTTP exception thrown: Instance 37911f69-fd30-484c-90b4-9cd552c97384 could not be found. Jul 28 10:44:34.147836 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] Returning 404 to user: Instance 37911f69-fd30-484c-90b4-9cd552c97384 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:44:34.148644 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a666f238-2807-4d42-a224-6197a9d21095 tempest-VolumesNegativeTest-1009626889 tempest-VolumesNegativeTest-1009626889-project] 10.222.0.25 "GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384" status: 404 len: 111 microversion: 2.1 time: 0.027914 Jul 28 10:44:34.149189 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 473/965] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:34 2021] GET /compute/v2.1/servers/37911f69-fd30-484c-90b4-9cd552c97384 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:44:41.916522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1864240798", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "e61368cc-7442-4a38-9400-53dc12aa35b1"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:41.969992 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] validate_networks() for [('e61368cc-7442-4a38-9400-53dc12aa35b1', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:44:42.355400 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:44:42.355820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:44:42.356292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:44:42.356699 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:44:42.357142 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:44:42.365814 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:42.366258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:42.367051 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:42.367484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:42.385016 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Getting quotas for project 79ceb16c404347a39c3fcf55328ff6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:44:42.388881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Getting quotas for user cc1915155a0c48a1b8e319e583fe6cdc and project 79ceb16c404347a39c3fcf55328ff6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:44:42.399993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:44:42.402316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:44:42.445142 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ff3c282c-bfdd-476d-ae41-fedb59087e2b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532177 Jul 28 10:44:42.445782 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 493/966] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:44:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:44:42.455371 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e831d87f-eee8-46d8-a3b7-b487cd37800b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:42.455981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e831d87f-eee8-46d8-a3b7-b487cd37800b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:42.510908 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e831d87f-eee8-46d8-a3b7-b487cd37800b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:42.517457 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e831d87f-eee8-46d8-a3b7-b487cd37800b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1219 microversion: 2.1 time: 0.065712 Jul 28 10:44:42.518017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 474/967] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:42 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:43.535472 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:43.536141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:43.542897 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:43.543439 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:43.544226 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:43.544663 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:43.614465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:43.621948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8d1b630e-3e4a-4619-aa71-2d2a3792d5fc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1277 microversion: 2.1 time: 0.090875 Jul 28 10:44:43.622515 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 494/968] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:43 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:44.639257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:44.639853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:44.646892 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:44.647422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:44.648222 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:44.648657 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:44.672563 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-0a61f8b0-3939-4332-aad1-6bfce14f3d96 req-9eb48719-e1ad-44a3-ae1b-b998fd67352b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82c5836-e0da-4ec1-b23a-60ab9030288c", "tag": "38020284-ab51-4961-9acf-1530ae3222bd"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:44.674844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:44:44.674844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:44:44.692403 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0a61f8b0-3939-4332-aad1-6bfce14f3d96 req-9eb48719-e1ad-44a3-ae1b-b998fd67352b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:44.692852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0a61f8b0-3939-4332-aad1-6bfce14f3d96 req-9eb48719-e1ad-44a3-ae1b-b998fd67352b service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:44.704446 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-0a61f8b0-3939-4332-aad1-6bfce14f3d96 req-9eb48719-e1ad-44a3-ae1b-b998fd67352b service nova] Creating event network-changed:38020284-ab51-4961-9acf-1530ae3222bd for instance e82c5836-e0da-4ec1-b23a-60ab9030288c on hv-cinder-80043 Jul 28 10:44:44.717664 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-0a61f8b0-3939-4332-aad1-6bfce14f3d96 req-9eb48719-e1ad-44a3-ae1b-b998fd67352b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049679 Jul 28 10:44:44.718477 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 495/969] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:44:44.792876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:44.800325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-940e13f5-cb3b-4944-82e0-53336cd6354a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1319 microversion: 2.1 time: 0.164773 Jul 28 10:44:44.800917 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 475/970] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:44 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:45.819548 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:45.820369 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:45.826274 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:45.826711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:45.827462 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:45.827886 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:45.958823 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:45.967102 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-aded017e-572d-4ea2-b56e-9a2f8ec19f88 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1319 microversion: 2.1 time: 0.152659 Jul 28 10:44:45.968236 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 496/971] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:45 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:46.984222 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:46.984956 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:46.991382 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:46.991833 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:46.992576 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:46.993030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:47.148110 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:47.155454 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7a96803a-9dc8-4a40-aa74-c008bc025bc3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1319 microversion: 2.1 time: 0.175092 Jul 28 10:44:47.156190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 476/972] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:46 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:48.172554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:48.173209 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:48.175613 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a8e605d-3fb3-4270-9825-b57c81bf7e2c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 10:44:48.180371 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:48.184050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:48.184050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:48.184050 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:48.309561 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:48.317505 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-66d0a2db-b5e7-46df-ba57-8aa4a324b93c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1319 microversion: 2.1 time: 0.148124 Jul 28 10:44:48.318080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 497/973] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:48 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:48.406129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-832debad-d354-4291-bbe2-7435ebf2a785 req-6c6a2a9b-6019-412c-b7fc-f9cb64299d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82c5836-e0da-4ec1-b23a-60ab9030288c", "name": "network-vif-plugged", "status": "completed", "tag": "38020284-ab51-4961-9acf-1530ae3222bd"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:44:48.407748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:44:48.407748 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:44:48.415435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-832debad-d354-4291-bbe2-7435ebf2a785 req-6c6a2a9b-6019-412c-b7fc-f9cb64299d96 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:48.415818 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-832debad-d354-4291-bbe2-7435ebf2a785 req-6c6a2a9b-6019-412c-b7fc-f9cb64299d96 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:48.428161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-832debad-d354-4291-bbe2-7435ebf2a785 req-6c6a2a9b-6019-412c-b7fc-f9cb64299d96 service nova] Creating event network-vif-plugged:38020284-ab51-4961-9acf-1530ae3222bd for instance e82c5836-e0da-4ec1-b23a-60ab9030288c on hv-cinder-80043 Jul 28 10:44:48.433574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-832debad-d354-4291-bbe2-7435ebf2a785 req-6c6a2a9b-6019-412c-b7fc-f9cb64299d96 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 Jul 28 10:44:48.434418 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 477/974] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:44:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:44:49.334848 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:49.335490 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:49.353425 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:49.353865 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:49.354630 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:49.355054 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:49.360354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a8e605d-3fb3-4270-9825-b57c81bf7e2c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 32826. Jul 28 10:44:49.478809 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:49.486272 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-10c36057-0769-45da-909c-e6c49c9e62cc tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1319 microversion: 2.1 time: 0.155868 Jul 28 10:44:49.486863 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 498/975] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:49 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:44:50.503978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:44:50.504648 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:44:50.511263 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:50.511707 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:50.512466 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:44:50.512933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:44:50.632423 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:44:50.639636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-eca6dc9b-94b2-4398-a3d0-d7a9930d2446 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1508 microversion: 2.1 time: 0.139790 Jul 28 10:44:50.640200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 478/976] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:44:50 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:10.008881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e21fc8a4-769d-45cc-90a1-494f2ec7eadc", "device": "/dev/sdb"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:10.010623 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:10.017315 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:10.017763 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:10.018539 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:10.018971 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:10.267267 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bd29f793-0741-4565-8165-1dd7ac9621c7 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "POST /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262347 Jul 28 10:45:10.267871 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 499/977] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:45:10 2021] POST /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:45:27.360805 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:45:27.361382 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:45:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:45:33.783529 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:33.784148 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:33.790165 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:33.790615 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:33.791378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:33.794843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:33.876234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lazy-loading 'services' on Instance uuid e82c5836-e0da-4ec1-b23a-60ab9030288c {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:45:33.940701 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-84da2642-ffaa-47c9-ba29-9b64abd99ca5 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c/os-volume_attachments/e21fc8a4-769d-45cc-90a1-494f2ec7eadc" status: 202 len: 0 microversion: 2.1 time: 0.160718 Jul 28 10:45:33.941381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 479/978] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:45:33 2021] DELETE /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c/os-volume_attachments/e21fc8a4-769d-45cc-90a1-494f2ec7eadc => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:45:35.063556 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:35.064283 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:35.071529 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:35.072066 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:35.073215 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:35.073819 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:35.098918 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:45:35.182182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0527ab8f-24a9-4363-8ce8-395908b454d1 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 204 len: 0 microversion: 2.1 time: 0.123751 Jul 28 10:45:35.182789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 500/979] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:45:35 2021] DELETE /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:45:35.191158 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:35.191993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:35.199064 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:35.199524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:35.200298 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:35.201104 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:35.322977 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:35.331233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a53faed4-7750-4343-b086-e1129de39707 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1514 microversion: 2.1 time: 0.143061 Jul 28 10:45:35.332419 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 480/980] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:35 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:36.349612 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:36.350318 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:36.356343 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:36.356897 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:36.357755 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:36.358197 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:36.478560 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:36.486713 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3d0751d3-21d6-43f6-979c-b7e9a8dda17c tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1514 microversion: 2.1 time: 0.141556 Jul 28 10:45:36.487327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 501/981] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:36 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:37.380088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-5405e9b4-6b65-41e6-bbce-dc03dac7a4f8 req-6d4b97b9-30c9-436c-b0d6-ffde55349ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82c5836-e0da-4ec1-b23a-60ab9030288c", "name": "network-vif-deleted", "tag": "38020284-ab51-4961-9acf-1530ae3222bd"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:37.381938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:45:37.381938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:45:37.388814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-5405e9b4-6b65-41e6-bbce-dc03dac7a4f8 req-6d4b97b9-30c9-436c-b0d6-ffde55349ff8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:37.389255 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-5405e9b4-6b65-41e6-bbce-dc03dac7a4f8 req-6d4b97b9-30c9-436c-b0d6-ffde55349ff8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:37.400879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-5405e9b4-6b65-41e6-bbce-dc03dac7a4f8 req-6d4b97b9-30c9-436c-b0d6-ffde55349ff8 service nova] Creating event network-vif-deleted:38020284-ab51-4961-9acf-1530ae3222bd for instance e82c5836-e0da-4ec1-b23a-60ab9030288c on hv-cinder-80043 Jul 28 10:45:37.405799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-5405e9b4-6b65-41e6-bbce-dc03dac7a4f8 req-6d4b97b9-30c9-436c-b0d6-ffde55349ff8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029466 Jul 28 10:45:37.406393 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 481/982] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:45:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:45:37.503272 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:37.503928 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:37.510337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:37.510788 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:37.511623 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:37.512063 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:37.545362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:37.545725 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:37.546423 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lazy-loading 'fault' on Instance uuid e82c5836-e0da-4ec1-b23a-60ab9030288c {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:45:37.586442 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:37.593634 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-fed598ec-2207-46bd-a995-2caa8922dc4e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 200 len: 1309 microversion: 2.1 time: 0.094085 Jul 28 10:45:37.594387 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 502/983] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:37 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:38.611579 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:38.612295 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: e82c5836-e0da-4ec1-b23a-60ab9030288c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:38.619351 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:38.619791 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:38.620547 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:38.621004 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:38.634689 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] HTTP exception thrown: Instance e82c5836-e0da-4ec1-b23a-60ab9030288c could not be found. Jul 28 10:45:38.635260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Returning 404 to user: Instance e82c5836-e0da-4ec1-b23a-60ab9030288c could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:45:38.636061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e8450992-8f14-4938-b792-58eb9390e55a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c" status: 404 len: 111 microversion: 2.1 time: 0.028524 Jul 28 10:45:38.636578 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 482/984] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:38 2021] GET /compute/v2.1/servers/e82c5836-e0da-4ec1-b23a-60ab9030288c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:45:47.425172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1021562459", "imageRef": "af8ad66e-855a-451e-af3a-947f95749bea", "flavorRef": "452", "networks": [{"uuid": "e61368cc-7442-4a38-9400-53dc12aa35b1"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:47.486466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] validate_networks() for [('e61368cc-7442-4a38-9400-53dc12aa35b1', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:45:47.865783 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:45:47.866211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:45:47.866689 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:45:47.867099 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:45:47.867516 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:45:47.877122 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:47.877575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:47.878383 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:47.879377 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:47.896974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Getting quotas for project 79ceb16c404347a39c3fcf55328ff6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:45:47.901111 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Getting quotas for user cc1915155a0c48a1b8e319e583fe6cdc and project 79ceb16c404347a39c3fcf55328ff6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:45:47.912670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:45:47.915117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='af8ad66e-855a-451e-af3a-947f95749bea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:45:47.967039 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f038ebaf-b1b4-4761-b105-f363b96a7214 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545553 Jul 28 10:45:47.967985 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 503/985] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:45:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:45:47.978544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0949efc9-cf3d-4af3-ab1b-f42f98c6cc3b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:47.979722 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0949efc9-cf3d-4af3-ab1b-f42f98c6cc3b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:48.097258 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0949efc9-cf3d-4af3-ab1b-f42f98c6cc3b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:48.104564 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0949efc9-cf3d-4af3-ab1b-f42f98c6cc3b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1219 microversion: 2.1 time: 0.130452 Jul 28 10:45:48.105635 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 483/986] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:47 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:49.125493 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:49.126768 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:49.141617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:49.142650 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:49.146468 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:49.147194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:49.270386 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:49.278705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-76d6d503-843b-4f87-b1ce-d1cee2f018a9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1289 microversion: 2.1 time: 0.158934 Jul 28 10:45:49.290183 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 504/987] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:49 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1289 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:50.298264 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:50.298885 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:50.302630 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e1d687f-4011-41b6-a34b-21fabf1e2853] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 10:45:50.312463 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:50.314003 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:50.318947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:50.319814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:50.540850 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:50.549684 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5d713263-7ecb-4c4b-b7c1-b722d90e40bd tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1319 microversion: 2.1 time: 0.255845 Jul 28 10:45:50.551860 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 484/988] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:50 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:50.722080 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-ba120bec-36f6-404d-941a-242572d9c1d9 req-e2ccbaf7-6e9d-45bc-ae6e-01122a642553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540d7e99-b8b3-4eda-b16f-7e03ac0eb779", "tag": "34e7c1d9-ec99-41cf-b8fa-c1f143b253b2"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:50.729893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:45:50.729893 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:45:50.743261 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-ba120bec-36f6-404d-941a-242572d9c1d9 req-e2ccbaf7-6e9d-45bc-ae6e-01122a642553 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:50.743701 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-ba120bec-36f6-404d-941a-242572d9c1d9 req-e2ccbaf7-6e9d-45bc-ae6e-01122a642553 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:50.766603 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-ba120bec-36f6-404d-941a-242572d9c1d9 req-e2ccbaf7-6e9d-45bc-ae6e-01122a642553 service nova] Creating event network-changed:34e7c1d9-ec99-41cf-b8fa-c1f143b253b2 for instance 540d7e99-b8b3-4eda-b16f-7e03ac0eb779 on hv-cinder-80043 Jul 28 10:45:50.772964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-ba120bec-36f6-404d-941a-242572d9c1d9 req-e2ccbaf7-6e9d-45bc-ae6e-01122a642553 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058157 Jul 28 10:45:50.773928 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 505/989] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:45:51.568879 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:51.569507 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:51.586922 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:51.587372 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:51.588142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:51.588581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:51.593727 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e1d687f-4011-41b6-a34b-21fabf1e2853] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 33566. Jul 28 10:45:51.727002 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:51.734574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4280bc8a-6014-474e-8049-15708d9b4438 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1319 microversion: 2.1 time: 0.170413 Jul 28 10:45:51.735136 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 485/990] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:51 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:52.753777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:52.755292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:52.767062 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:52.767880 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:52.768958 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:52.770211 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:52.961016 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:52.970056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ead5f6a9-7307-4f15-b8e9-7d2bdcbff10b tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1319 microversion: 2.1 time: 0.220214 Jul 28 10:45:52.972401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 506/991] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:52 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:53.990812 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:53.992802 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:54.001981 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:54.002463 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:54.003338 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:54.004373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:54.230074 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:54.245087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b908a2be-c4cb-4c64-ae30-59e5e1a4c44e tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1319 microversion: 2.1 time: 0.260024 Jul 28 10:45:54.246005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 486/992] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:53 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:55.261840 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:55.263533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:55.274448 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-749c84ef-b451-4db5-8a3e-830efea33d53 req-8f412221-16ba-498e-b7aa-7cfcae04894e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540d7e99-b8b3-4eda-b16f-7e03ac0eb779", "name": "network-vif-plugged", "status": "completed", "tag": "34e7c1d9-ec99-41cf-b8fa-c1f143b253b2"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:55.276161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:45:55.276161 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:45:55.303056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:55.303520 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:55.304375 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:55.304833 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:55.307348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-749c84ef-b451-4db5-8a3e-830efea33d53 req-8f412221-16ba-498e-b7aa-7cfcae04894e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:55.321477 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-749c84ef-b451-4db5-8a3e-830efea33d53 req-8f412221-16ba-498e-b7aa-7cfcae04894e service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:55.333936 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-749c84ef-b451-4db5-8a3e-830efea33d53 req-8f412221-16ba-498e-b7aa-7cfcae04894e service nova] Creating event network-vif-plugged:34e7c1d9-ec99-41cf-b8fa-c1f143b253b2 for instance 540d7e99-b8b3-4eda-b16f-7e03ac0eb779 on hv-cinder-80043 Jul 28 10:45:55.346820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-749c84ef-b451-4db5-8a3e-830efea33d53 req-8f412221-16ba-498e-b7aa-7cfcae04894e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077646 Jul 28 10:45:55.348332 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 487/993] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:45:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:45:55.483424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:55.493875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-44e02147-bad8-4523-8927-dc49511c15c8 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1319 microversion: 2.1 time: 0.235980 Jul 28 10:45:55.499599 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 507/994] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:55 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:56.515685 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:56.516370 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:56.543474 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:56.545332 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:56.546345 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:56.548723 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:56.743292 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:56.751262 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-2de62290-a58e-41f0-87e2-47a1ab1b899f tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1319 microversion: 2.1 time: 0.239545 Jul 28 10:45:56.751826 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 488/995] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:56 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:57.769696 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:45:57.771427 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:57.779249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:57.779689 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:57.780454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:57.781060 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:57.922395 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:45:57.930401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8c9c920b-0948-4d3b-9c9b-73f948bd0a70 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1508 microversion: 2.1 time: 0.165918 Jul 28 10:45:57.930967 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 508/996] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:45:57 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:45:57.948191 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a230d94f-8ad2-4a6c-b94d-6fc2079dcf15", "device": "/dev/sdb"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:45:57.949760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:45:57.956013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:57.957458 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:57.958878 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:45:57.959468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:45:58.276672 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-47182436-883f-4d6c-be7c-f0f47cf576c3 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "POST /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332091 Jul 28 10:45:58.277987 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 489/997] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:45:57 2021] POST /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:46:05.096460 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-91a370bc-6357-4770-803b-af2989540910 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Action: 'create', calling method: .version_select at 0x7fe477779280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-483175469"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:05.115031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-91a370bc-6357-4770-803b-af2989540910 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Getting quotas for project c629d862dae14c7486856432ac104059. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:46:05.118792 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-91a370bc-6357-4770-803b-af2989540910 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Getting quotas for user 050795ba48e348ad8606970045654def and project c629d862dae14c7486856432ac104059. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:46:05.349020 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-91a370bc-6357-4770-803b-af2989540910 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Getting quotas for project c629d862dae14c7486856432ac104059. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:46:05.352732 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-91a370bc-6357-4770-803b-af2989540910 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Getting quotas for user 050795ba48e348ad8606970045654def and project c629d862dae14c7486856432ac104059. Resources: {'key_pairs'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:46:05.367832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-91a370bc-6357-4770-803b-af2989540910 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.274975 Jul 28 10:46:05.368430 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 509/998] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Jul 28 10:46:05 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:05.414939 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-433284327", "imageRef": "95309a36-404b-4fe2-883f-0ceae3709329", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-483175469", "networks": [{"uuid": "621974ff-43f6-47e9-8a8e-c2e782ef2401"}]}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:05.472925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] validate_networks() for [('621974ff-43f6-47e9-8a8e-c2e782ef2401', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:46:06.172980 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:46:06.173400 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:46:06.173866 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:46:06.174359 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:46:06.174772 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:46:06.183645 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:06.184088 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:06.184919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:06.185347 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:06.201140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Getting quotas for project c629d862dae14c7486856432ac104059. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:46:06.205018 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Getting quotas for user 050795ba48e348ad8606970045654def and project c629d862dae14c7486856432ac104059. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:46:06.215975 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:46:06.218225 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='95309a36-404b-4fe2-883f-0ceae3709329',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:46:06.262374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1bcd7b22-7979-4dc2-a353-053b20d71cc3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851780 Jul 28 10:46:06.263026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 490/999] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:46:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 10:46:06.273208 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-00eaab59-43f2-4c88-af49-8aab226a52ef tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:06.273820 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-00eaab59-43f2-4c88-af49-8aab226a52ef tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:06.324534 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-00eaab59-43f2-4c88-af49-8aab226a52ef tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:06.333017 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-00eaab59-43f2-4c88-af49-8aab226a52ef tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1257 microversion: 2.1 time: 0.064001 Jul 28 10:46:06.333567 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 510/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:06 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1257 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:07.349752 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:07.350289 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:07.356400 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:07.356882 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:07.357645 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:07.358074 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:07.416478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:07.423628 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-62876650-5dcd-4a16-8e61-c9a8ecdee5b5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1261 microversion: 2.1 time: 0.077718 Jul 28 10:46:07.424180 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 491/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:07 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:08.441238 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:08.441707 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:08.447500 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:08.447947 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:08.448709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:08.449170 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:08.506235 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:08.513244 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-70d74f2d-a979-40c2-9a46-7762680317a0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1261 microversion: 2.1 time: 0.076457 Jul 28 10:46:08.513807 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 511/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:08 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:09.529043 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:09.529674 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:09.535558 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:09.535998 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:09.536773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:09.537208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:09.595068 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:09.603570 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-9c0a7164-0678-49ac-9bc4-2f1a44982fd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1309 microversion: 2.1 time: 0.078186 Jul 28 10:46:09.604140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 492/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:09 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1309 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:10.620851 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:10.622490 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:10.632389 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:10.632862 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:10.633842 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:10.634476 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:10.790606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:10.800322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-89707ffa-3294-4a5a-9bd2-b69f6457fca8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.183778 Jul 28 10:46:10.801832 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 512/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:10 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:11.818638 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:11.819260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:11.825563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:11.826010 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:11.826773 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:11.827230 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:11.950066 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:11.958813 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-69789a8e-b541-43bd-8350-2c3490eb9e99 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.144069 Jul 28 10:46:11.959760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 493/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:11 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:12.977056 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:12.977594 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:12.983392 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:12.983963 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:12.984879 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:12.985316 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:13.122955 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:13.139869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-89a116e9-92b6-4951-b0c7-ef49395bacf4 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.167078 Jul 28 10:46:13.140839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 513/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:12 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:14.157642 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:14.158490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:14.165651 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:14.166096 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:14.166872 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:14.167310 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:14.299930 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:14.308201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-08b7b3dd-ba4a-4787-a2a8-671bb47795a3 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.154138 Jul 28 10:46:14.308832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 494/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:14 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:15.325979 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:15.326804 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:15.332972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:15.333502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:15.334351 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:15.334872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:15.459260 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:15.467359 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-cab702ca-d37b-4260-8b75-5c7df9826377 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.145285 Jul 28 10:46:15.468125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 514/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:15 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:16.485283 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:16.485900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:16.493303 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:16.494038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:16.495183 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:16.495820 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:16.620904 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:16.628800 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ac77c274-3c61-4d1d-ae29-ec65f7eb87ab tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.147317 Jul 28 10:46:16.630485 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 495/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:16 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:17.647133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:17.647852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:17.653591 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:17.654031 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:17.654782 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:17.655212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:17.851304 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:17.851910 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:17.857881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:17.858328 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:17.859100 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:17.859537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:17.889554 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:17.907612 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-683fa873-180b-41c3-bfc8-e823586fe1cc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.264648 Jul 28 10:46:17.920340 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 515/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:17 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:17.949374 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lazy-loading 'services' on Instance uuid 540d7e99-b8b3-4eda-b16f-7e03ac0eb779 {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:46:18.018720 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a1d9b31a-d179-4d24-bf9d-ef5dae3d8af2 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779/os-volume_attachments/a230d94f-8ad2-4a6c-b94d-6fc2079dcf15" status: 202 len: 0 microversion: 2.1 time: 0.171008 Jul 28 10:46:18.019304 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 496/1011] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:46:17 2021] DELETE /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779/os-volume_attachments/a230d94f-8ad2-4a6c-b94d-6fc2079dcf15 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 10:46:18.927296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:18.928003 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:18.933908 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:18.934347 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:18.935097 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:18.935523 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:19.059872 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:19.068576 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0cd53424-4e8b-499a-b283-50f1b33f68f5 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.144208 Jul 28 10:46:19.072522 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 516/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:18 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:20.086537 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:20.087231 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:20.093605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:20.094062 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:20.094840 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:20.095279 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:20.235451 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:20.242858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-11fe989d-2d4b-422c-a4e4-1aa0cfda1f8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.160873 Jul 28 10:46:20.243426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 497/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:20 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:21.265995 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:21.266582 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:21.272858 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:21.273330 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:21.274144 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:21.274572 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:21.489615 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:21.497027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9a85fa65-94a7-4ba4-8892-2ce616e55f3f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.241018 Jul 28 10:46:21.497598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 517/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:21 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:21.795520 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-eb0cd90e-7313-4f09-9459-4e3387fb97b1 req-ec34096e-9ac3-4433-8246-050bb24c3d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:21.797147 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:46:21.797147 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:46:21.811336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-eb0cd90e-7313-4f09-9459-4e3387fb97b1 req-ec34096e-9ac3-4433-8246-050bb24c3d5a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:21.811778 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-eb0cd90e-7313-4f09-9459-4e3387fb97b1 req-ec34096e-9ac3-4433-8246-050bb24c3d5a service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:21.824343 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-eb0cd90e-7313-4f09-9459-4e3387fb97b1 req-ec34096e-9ac3-4433-8246-050bb24c3d5a service nova] Creating event network-changed:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:46:21.830163 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-eb0cd90e-7313-4f09-9459-4e3387fb97b1 req-ec34096e-9ac3-4433-8246-050bb24c3d5a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045097 Jul 28 10:46:21.830760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 498/1015] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:46:22.319333 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:22.319869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:22.325688 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:22.326137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:22.326938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:22.327373 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:22.352104 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:46:22.429292 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3832e6c9-c6b9-4323-99c8-0b6408df8962 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "DELETE /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 204 len: 0 microversion: 2.1 time: 0.113557 Jul 28 10:46:22.430174 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 518/1016] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:46:22 2021] DELETE /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:46:22.438644 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:22.439336 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:22.445978 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:22.446420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:22.447184 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:22.447616 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:22.514313 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:22.515008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:22.522670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:22.522670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:22.523373 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:22.523801 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:22.575325 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:22.582724 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-c8af75b1-3ff9-457a-9bac-d2346fc8306a tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1514 microversion: 2.1 time: 0.148031 Jul 28 10:46:22.583969 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 499/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:22 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:46:22.689725 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:22.697160 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e3401bd1-0a99-4e9c-9711-6d9142276c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.187104 Jul 28 10:46:22.697736 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 519/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:22 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:46:23.601285 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:23.601896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:23.607691 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:23.608131 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:23.608919 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:23.609344 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:23.714118 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:23.714815 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:23.720953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:23.721405 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:23.722205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:23.722639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:23.729225 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:23.741491 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-6e81e17f-787f-49fb-a380-989290be04c9 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1514 microversion: 2.1 time: 0.144794 Jul 28 10:46:23.742079 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 500/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:23 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:23.842880 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:23.850655 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-da3d089a-10ac-4705-8f92-c01da1dc59a8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.140448 Jul 28 10:46:23.851220 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 520/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:23 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:46:24.763401 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:24.764050 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:24.770187 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:24.770646 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:24.771435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:24.771874 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:24.868671 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:24.869317 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:24.875883 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:24.876334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:24.877141 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:24.877570 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:24.898894 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc1915155a0c48a1b8e319e583fe6cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ceb16c404347a39c3fcf55328ff6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:24.906914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0b59cd71-7cf0-4f7d-bcb1-938bf4da41db tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 200 len: 1514 microversion: 2.1 time: 0.147025 Jul 28 10:46:24.907498 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 501/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:24 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:25.110266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-41f3dfd1-4f81-4c36-b48a-18f80840f844 req-91e05ffb-643b-4204-b461-a853854aff27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540d7e99-b8b3-4eda-b16f-7e03ac0eb779", "name": "network-vif-deleted", "tag": "34e7c1d9-ec99-41cf-b8fa-c1f143b253b2"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:25.111729 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:25.112017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:46:25.112017 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:46:25.119855 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-41f3dfd1-4f81-4c36-b48a-18f80840f844 req-91e05ffb-643b-4204-b461-a853854aff27 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:25.120379 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-41f3dfd1-4f81-4c36-b48a-18f80840f844 req-91e05ffb-643b-4204-b461-a853854aff27 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:25.121502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-da62208f-0fa4-4cab-84d7-93435c32fa77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.257721 Jul 28 10:46:25.122265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 521/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:24 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:46:25.131976 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-41f3dfd1-4f81-4c36-b48a-18f80840f844 req-91e05ffb-643b-4204-b461-a853854aff27 service nova] Creating event network-vif-deleted:34e7c1d9-ec99-41cf-b8fa-c1f143b253b2 for instance 540d7e99-b8b3-4eda-b16f-7e03ac0eb779 on hv-cinder-80043 Jul 28 10:46:25.136875 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-41f3dfd1-4f81-4c36-b48a-18f80840f844 req-91e05ffb-643b-4204-b461-a853854aff27 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030425 Jul 28 10:46:25.137451 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 502/1023] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:46:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:46:25.924300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:25.924936 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] [instance: 540d7e99-b8b3-4eda-b16f-7e03ac0eb779] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:25.931743 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:25.932179 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:25.932972 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:25.933401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:25.946521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] HTTP exception thrown: Instance 540d7e99-b8b3-4eda-b16f-7e03ac0eb779 could not be found. Jul 28 10:46:25.947089 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] Returning 404 to user: Instance 540d7e99-b8b3-4eda-b16f-7e03ac0eb779 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:46:25.947891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0860e8e4-abe3-4a7d-bc5c-6c670bed7829 tempest-VolumesSnapshotTestJSON-1856435956 tempest-VolumesSnapshotTestJSON-1856435956-project] 10.222.0.25 "GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779" status: 404 len: 111 microversion: 2.1 time: 0.027253 Jul 28 10:46:25.948401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 522/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:25 2021] GET /compute/v2.1/servers/540d7e99-b8b3-4eda-b16f-7e03ac0eb779 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:46:26.139042 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:26.139737 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:26.147144 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:26.147709 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:26.148634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:26.149281 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:26.282140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:26.291185 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7086a70b-6692-4d45-a3c0-2919b7f2cd64 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.156291 Jul 28 10:46:26.291765 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 503/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:26 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:27.308034 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:27.309021 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:27.314939 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:27.315390 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:27.316182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:27.316617 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:27.441216 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:27.449091 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-2252dd11-f8a2-479f-906d-fed676fdd0fc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.144702 Jul 28 10:46:27.449647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 523/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:27 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:28.466521 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:28.467126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:28.473005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:28.474081 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:28.475008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:28.475435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:28.591089 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:28.598229 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-4fb365c3-e50f-4272-b6f3-2ffdf33bebfc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.135351 Jul 28 10:46:28.599881 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 504/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:28 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:29.616182 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:29.616805 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:29.622757 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:29.623196 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:29.623947 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:29.624376 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:29.745771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:29.753149 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-5e592982-5611-4b04-afc3-26849ec02d6f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.140924 Jul 28 10:46:29.753712 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 524/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:29 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:30.770202 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:30.770900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:30.777004 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:30.777523 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:30.778389 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:30.778931 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:30.899499 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:30.906626 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-efa0cdb5-f391-4682-9044-e186de72297d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.140089 Jul 28 10:46:30.907187 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 505/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:30 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:31.481327 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-950f7f0e-46c2-4755-be06-78759b1e59b2 req-f7cc4985-29b8-4f02-9050-46a3e9c31612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "name": "network-vif-plugged", "status": "completed", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:31.482917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:46:31.482917 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:46:31.490620 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-950f7f0e-46c2-4755-be06-78759b1e59b2 req-f7cc4985-29b8-4f02-9050-46a3e9c31612 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:31.491057 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-950f7f0e-46c2-4755-be06-78759b1e59b2 req-f7cc4985-29b8-4f02-9050-46a3e9c31612 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:31.502185 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-950f7f0e-46c2-4755-be06-78759b1e59b2 req-f7cc4985-29b8-4f02-9050-46a3e9c31612 service nova] Creating event network-vif-plugged:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:46:31.507693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-950f7f0e-46c2-4755-be06-78759b1e59b2 req-f7cc4985-29b8-4f02-9050-46a3e9c31612 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030016 Jul 28 10:46:31.508280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 525/1030] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:46:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:46:31.924064 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:31.924681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:31.931027 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:31.931490 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:31.932244 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:31.932656 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:32.055113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:32.062241 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0f4c4b5f-8f16-4092-a128-b54865ffa164 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1357 microversion: 2.1 time: 0.141747 Jul 28 10:46:32.062803 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 506/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:31 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:33.079873 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:33.080565 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:33.087239 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.087685 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.088462 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.088906 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.211117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:33.228875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0af49b63-647c-48b6-9adc-d74764f16a7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1547 microversion: 2.1 time: 0.152836 Jul 28 10:46:33.240531 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 526/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:33 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:33.245326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:33.245997 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:33.252258 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.252928 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.253769 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.254373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.374954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:33.382384 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d0bdd4d3-1202-4955-9a01-af8d3954a6c9 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1547 microversion: 2.1 time: 0.140910 Jul 28 10:46:33.382947 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 507/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:33 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1547 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:33.398150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:33.401426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:46:33.401426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:46:33.402420 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:33.403165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Searching by: {'deleted': False, 'project_id': 'c629d862dae14c7486856432ac104059'} {{(pid=119120) get_all /opt/stack/nova/nova/compute/api.py:2833}} Jul 28 10:46:33.409764 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.410213 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.411732 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.412166 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.501454 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.multi_cell_list [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 28 10:46:33.593045 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f39f8a53-0a12-4be3-8ee2-b4bdb7fbf32b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198870 Jul 28 10:46:33.593631 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 527/1034] 10.222.0.25 () {58 vars in 1125 bytes} [Wed Jul 28 10:46:33 2021] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:46:33.606211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:33.606830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:33.612813 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.613421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.614831 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:33.615269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:33.733090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:33.740920 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0cbe6590-1018-490d-91af-64e1d26d4fa8 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1547 microversion: 2.1 time: 0.139234 Jul 28 10:46:33.741487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 508/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:33 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1547 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:35.248877 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03d1899b-0bff-49c0-9e6f-e9c0b505cb50"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:35.249930 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:35.256317 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:35.256783 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:35.257550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:35.257997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:37.539075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c3c1be1d-42aa-4f71-a3f1-13eb749b840d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.294047 Jul 28 10:46:37.539751 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 528/1036] 10.222.0.25 () {60 vars in 1323 bytes} [Wed Jul 28 10:46:35 2021] POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments => generated 194 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:46:45.104494 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:45.105135 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:45.111373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:45.111813 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:45.112568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:45.113025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:45.234208 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:45.242129 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0273ddd4-4e3b-471b-b16e-f0b98fae9e7e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1593 microversion: 2.1 time: 0.141198 Jul 28 10:46:45.242697 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 509/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:45 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1593 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:46.889231 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-a8cbeaaf-209a-4500-8b96-83822495605e req-418a829c-bf26-41fb-9060-0c1034bb038c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:46.890953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:46:46.890953 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:46:46.904563 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-a8cbeaaf-209a-4500-8b96-83822495605e req-418a829c-bf26-41fb-9060-0c1034bb038c service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:46.905322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-a8cbeaaf-209a-4500-8b96-83822495605e req-418a829c-bf26-41fb-9060-0c1034bb038c service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:46.916825 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-a8cbeaaf-209a-4500-8b96-83822495605e req-418a829c-bf26-41fb-9060-0c1034bb038c service nova] Creating event network-changed:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:46:46.922252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-a8cbeaaf-209a-4500-8b96-83822495605e req-418a829c-bf26-41fb-9060-0c1034bb038c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036853 Jul 28 10:46:46.922841 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 529/1038] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:46:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:46:47.963590 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1334014936"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:47.964168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:47.971107 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:47.971556 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:47.972386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:47.972842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:48.173784 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.network.security_group_api [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Adding security group 0c3fad19-9b17-4bd9-96f9-c67cbd2bfcad to port ec6da845-0d32-4939-977f-83ac4d39f421 Jul 28 10:46:48.553262 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-001c4718-fcd8-4e93-8a11-4e36c80a551d tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/action" status: 202 len: 0 microversion: 2.1 time: 0.594618 Jul 28 10:46:48.554506 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 510/1039] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:46:47 2021] POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:46:48.562524 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:46:48.563231 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:46:48.570222 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:48.570983 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:48.572496 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:48.573473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:48.761265 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:46:48.771391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7b76e882-c191-4c46-a763-933d60a9495f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1758 microversion: 2.1 time: 0.212089 Jul 28 10:46:48.783296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 530/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:46:48 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1758 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:46:48.938690 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-890f46e0-a8aa-4b65-8665-e3699d21b99a req-f91ff5b0-d58d-4f07-9e32-ebfe31161a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:46:48.940150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:46:48.940150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:46:48.948033 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-890f46e0-a8aa-4b65-8665-e3699d21b99a req-f91ff5b0-d58d-4f07-9e32-ebfe31161a05 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:46:48.948687 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-890f46e0-a8aa-4b65-8665-e3699d21b99a req-f91ff5b0-d58d-4f07-9e32-ebfe31161a05 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:46:48.962132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-890f46e0-a8aa-4b65-8665-e3699d21b99a req-f91ff5b0-d58d-4f07-9e32-ebfe31161a05 service nova] Creating event network-changed:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:46:48.968116 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-890f46e0-a8aa-4b65-8665-e3699d21b99a req-f91ff5b0-d58d-4f07-9e32-ebfe31161a05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033099 Jul 28 10:46:48.969479 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 511/1041] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:46:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:47:05.854476 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:47:05.855418 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:05.861660 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:05.862107 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:05.862869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:05.863304 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:05.938223 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e0c61382-a0e0-4cfd-b218-e569a3321adb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/action" status: 202 len: 0 microversion: 2.1 time: 0.087268 Jul 28 10:47:05.938839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 531/1042] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:47:05 2021] POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:47:05.949452 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:05.950150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:05.956845 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:05.957435 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:05.958203 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:05.959731 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:06.285047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:06.293363 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-386ed087-541b-4195-8011-b753a11be4bb tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1750 microversion: 2.1 time: 0.350179 Jul 28 10:47:06.294023 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 512/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:05 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1750 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:07.311543 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:07.312241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:07.318353 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:07.318791 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:07.319560 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:07.319993 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:07.490238 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:07.498145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-62644084-b1a0-484b-b18a-593936a3fa3a tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.190603 Jul 28 10:47:07.498709 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 532/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:07 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:08.515475 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:08.516092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:08.522764 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:08.523211 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:08.524024 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:08.524409 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:08.645762 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:08.653605 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-553197fa-b24c-466d-be4c-a8b8d0734d58 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.141847 Jul 28 10:47:08.654176 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 513/1045] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:08 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:09.671086 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:09.671731 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:09.678386 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:09.678838 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:09.679606 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:09.680043 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:09.803720 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:09.811938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-226e07c9-e6e0-408c-80bc-a2d2112dbcd7 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.144513 Jul 28 10:47:09.812508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 533/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:09 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:10.829747 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:10.830326 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:10.836729 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:10.837190 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:10.837959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:10.838398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:10.956932 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:10.965351 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e813a38e-3603-4aee-9b36-8f6051c7447e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.139403 Jul 28 10:47:10.965914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 514/1047] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:10 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:11.982222 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:11.982844 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:11.989126 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:11.990133 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:11.990938 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:11.991372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:12.110629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:12.118956 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-78fa8f09-b8c9-4b8c-99ef-1b8f77dca674 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.140389 Jul 28 10:47:12.119526 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 534/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:11 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:13.136815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:13.137422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:13.143197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:13.143636 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:13.144390 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:13.144843 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:13.266233 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:13.274142 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-bc8107e4-97ee-4fff-94f8-f22914cb998e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.141019 Jul 28 10:47:13.274726 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 515/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:13 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:14.291240 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:14.291854 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:14.297804 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:14.298254 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:14.299027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:14.299466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:14.417964 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:14.425711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bf517194-fa5e-422c-ab07-78490468c347 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.138309 Jul 28 10:47:14.426282 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 535/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:14 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:47:15.444025 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:15.444635 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:15.450419 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:15.450864 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:15.451611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:15.452038 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:15.572137 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:15.579853 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-765598a2-7e7c-4255-9813-d121ddfec9ac tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.140439 Jul 28 10:47:15.580410 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 516/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:15 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:16.598030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:16.599243 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:16.605222 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:16.605667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:16.606433 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:16.606890 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:16.729322 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:16.737023 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4a12bfcd-ac9f-4ee5-8e66-defb78d416f0 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1755 microversion: 2.1 time: 0.142660 Jul 28 10:47:16.737587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 536/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:16 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1755 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:17.754381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:17.754987 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:17.760963 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:17.761405 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:17.762156 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:17.762583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:17.882463 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:17.890149 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-380ff95e-5fc3-47d5-9d8d-de67801f5a34 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1758 microversion: 2.1 time: 0.139419 Jul 28 10:47:17.890717 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 517/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:17 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1758 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:50.869354 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1334014936"}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:47:50.869924 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:50.875983 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:50.876424 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:50.877209 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:50.877636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:50.992257 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.network.security_group_api [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Removing security group 0c3fad19-9b17-4bd9-96f9-c67cbd2bfcad from port ec6da845-0d32-4939-977f-83ac4d39f421 Jul 28 10:47:51.316094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-be611196-2624-4b56-a198-eaaacf422c7b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/action" status: 202 len: 0 microversion: 2.1 time: 0.450608 Jul 28 10:47:51.319975 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 537/1054] 10.222.0.25 () {60 vars in 1278 bytes} [Wed Jul 28 10:47:50 2021] POST /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:47:51.327779 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-2fcde728-fa59-4c93-aab0-6b72325ba5b6 req-de74566e-78eb-4bf7-a4ae-a0e0512b2422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:47:51.329301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:47:51.329301 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:47:51.336663 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-2fcde728-fa59-4c93-aab0-6b72325ba5b6 req-de74566e-78eb-4bf7-a4ae-a0e0512b2422 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:51.337145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-2fcde728-fa59-4c93-aab0-6b72325ba5b6 req-de74566e-78eb-4bf7-a4ae-a0e0512b2422 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:51.355236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-2fcde728-fa59-4c93-aab0-6b72325ba5b6 req-de74566e-78eb-4bf7-a4ae-a0e0512b2422 service nova] Creating event network-changed:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:47:51.369406 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-2fcde728-fa59-4c93-aab0-6b72325ba5b6 req-de74566e-78eb-4bf7-a4ae-a0e0512b2422 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045482 Jul 28 10:47:51.370447 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 518/1055] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:47:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:47:52.608676 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:52.609249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:52.611997 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-3cf1f122-ed88-4398-ab3c-63b8da05c69b req-cd9ba091-39d5-49d4-b61b-20fe7b077fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:47:52.614453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:47:52.614453 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:47:52.615548 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:52.615998 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:52.616864 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:52.617337 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:52.622375 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-3cf1f122-ed88-4398-ab3c-63b8da05c69b req-cd9ba091-39d5-49d4-b61b-20fe7b077fe9 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:52.622890 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-3cf1f122-ed88-4398-ab3c-63b8da05c69b req-cd9ba091-39d5-49d4-b61b-20fe7b077fe9 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:52.633751 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-3cf1f122-ed88-4398-ab3c-63b8da05c69b req-cd9ba091-39d5-49d4-b61b-20fe7b077fe9 service nova] Creating event network-changed:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:47:52.638681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-3cf1f122-ed88-4398-ab3c-63b8da05c69b req-cd9ba091-39d5-49d4-b61b-20fe7b077fe9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030863 Jul 28 10:47:52.639348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 519/1056] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:47:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:47:52.715296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.objects.instance [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lazy-loading 'services' on Instance uuid 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 {{(pid=119120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:47:52.786449 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-4007caf0-b308-4bd8-9b69-07bc53dcffcc tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments/03d1899b-0bff-49c0-9e6f-e9c0b505cb50" status: 202 len: 0 microversion: 2.1 time: 0.180846 Jul 28 10:47:52.788057 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 538/1057] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:47:52 2021] DELETE /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments/03d1899b-0bff-49c0-9e6f-e9c0b505cb50 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:47:52.798418 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:52.799746 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:52.808511 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:52.809471 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:52.810531 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:52.811042 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:52.852982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8d5a7e68-f039-4fcc-b9c5-a41a16d64e9e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058722 Jul 28 10:47:52.853558 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 520/1058] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Jul 28 10:47:52 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:47:53.865852 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:53.866900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:53.873266 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:53.873710 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:53.874466 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:53.874925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:53.903391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-794b93d9-4ca0-44a4-a4c9-2ba83e25b195 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042194 Jul 28 10:47:53.903940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 539/1059] 10.222.0.25 () {58 vars in 1302 bytes} [Wed Jul 28 10:47:53 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 10:47:53.914005 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:53.914517 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:53.920201 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:53.920643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:53.921426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:53.921856 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:53.997925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] HTTP exception thrown: Instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 is not attached to volume 03d1899b-0bff-49c0-9e6f-e9c0b505cb50 Jul 28 10:47:53.998558 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Returning 404 to user: Instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 is not attached to volume 03d1899b-0bff-49c0-9e6f-e9c0b505cb50 {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:47:53.999413 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ce3b8383-044b-4da2-9495-a910128b9b8f tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments/03d1899b-0bff-49c0-9e6f-e9c0b505cb50" status: 404 len: 154 microversion: 2.1 time: 0.089795 Jul 28 10:47:54.000008 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 521/1060] 10.222.0.25 () {58 vars in 1416 bytes} [Wed Jul 28 10:47:53 2021] DELETE /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7/os-volume_attachments/03d1899b-0bff-49c0-9e6f-e9c0b505cb50 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:47:55.130686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:55.131190 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:55.136965 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:55.137420 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:55.138188 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:55.138625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:55.162519 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:47:55.234656 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0ffc51b4-4a01-4d2f-9bc3-225bd9e66f1e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 204 len: 0 microversion: 2.1 time: 0.107268 Jul 28 10:47:55.235299 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 540/1061] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:47:55 2021] DELETE /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:47:55.244098 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:55.244712 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:55.250805 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:55.251252 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:55.252013 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:55.252449 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:55.372574 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:55.379993 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-41b68f90-6153-4934-ba16-6624b058257e tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1553 microversion: 2.1 time: 0.139528 Jul 28 10:47:55.380551 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 522/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:55 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1553 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:47:56.398268 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:56.398903 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:56.404793 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:56.405248 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:56.406030 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:56.406486 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:56.533131 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:56.540323 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-89545542-741f-41c7-895a-b89cb19a49c6 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1553 microversion: 2.1 time: 0.146650 Jul 28 10:47:56.540916 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 541/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:56 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:47:57.507063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-2eb32c5c-6869-4b06-9bd5-c681b98fd470 req-6c482947-adfb-4347-8cb9-e0aecc793451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7", "name": "network-vif-deleted", "tag": "ec6da845-0d32-4939-977f-83ac4d39f421"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:47:57.508814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:47:57.508814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:47:57.515669 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-2eb32c5c-6869-4b06-9bd5-c681b98fd470 req-6c482947-adfb-4347-8cb9-e0aecc793451 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:57.516107 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-2eb32c5c-6869-4b06-9bd5-c681b98fd470 req-6c482947-adfb-4347-8cb9-e0aecc793451 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:57.527497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-2eb32c5c-6869-4b06-9bd5-c681b98fd470 req-6c482947-adfb-4347-8cb9-e0aecc793451 service nova] Creating event network-vif-deleted:ec6da845-0d32-4939-977f-83ac4d39f421 for instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 on hv-cinder-80043 Jul 28 10:47:57.532939 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-2eb32c5c-6869-4b06-9bd5-c681b98fd470 req-6c482947-adfb-4347-8cb9-e0aecc793451 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030293 Jul 28 10:47:57.533641 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 523/1064] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:47:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:47:57.557217 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:57.557836 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:57.563850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:57.564300 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:57.565557 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:57.566002 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:57.627881 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '050795ba48e348ad8606970045654def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c629d862dae14c7486856432ac104059', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:47:57.636475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-98d86ad2-3971-44d0-bfd4-0ae4568fc44b tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 200 len: 1342 microversion: 2.1 time: 0.083827 Jul 28 10:47:57.637077 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 542/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:57 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 1342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:47:58.653907 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:58.654608 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] [instance: 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:47:58.661555 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:58.662034 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:58.662806 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:47:58.663247 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:47:58.676186 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] HTTP exception thrown: Instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 could not be found. Jul 28 10:47:58.676904 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Returning 404 to user: Instance 4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:47:58.677728 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8c0fc9ff-6dcb-401e-ad12-17db91589c22 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7" status: 404 len: 111 microversion: 2.1 time: 0.027951 Jul 28 10:47:58.678242 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 524/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:47:58 2021] GET /compute/v2.1/servers/4e6ee1a7-3ea6-4352-af5c-acf0f8a485a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:47:58.686118 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-42ff1904-3c28-47e2-9921-8ac65ab98f77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] Calling method '.version_select at 0x7fe4776cda60>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:47:58.704686 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-42ff1904-3c28-47e2-9921-8ac65ab98f77 tempest-TestMinimumBasicScenario-1503162241 tempest-TestMinimumBasicScenario-1503162241-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-483175469" status: 202 len: 0 microversion: 2.1 time: 0.022172 Jul 28 10:47:58.705281 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 543/1067] 10.222.0.25 () {58 vars in 1269 bytes} [Wed Jul 28 10:47:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-483175469 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:48:16.001975 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-daec697c-3a81-4fa5-9ab3-9125527943ce tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Action: 'create', calling method: .version_select at 0x7fe477697b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2074491997"}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:16.027086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-daec697c-3a81-4fa5-9ab3-9125527943ce tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for project 6525d100052a4861b65a019a6d374764. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:48:16.031126 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-daec697c-3a81-4fa5-9ab3-9125527943ce tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for user f6e6f8b50b874ec882ed7e661fc6f831 and project 6525d100052a4861b65a019a6d374764. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:48:16.146539 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-daec697c-3a81-4fa5-9ab3-9125527943ce tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for project 6525d100052a4861b65a019a6d374764. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:48:16.150282 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-daec697c-3a81-4fa5-9ab3-9125527943ce tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for user f6e6f8b50b874ec882ed7e661fc6f831 and project 6525d100052a4861b65a019a6d374764. Resources: {'key_pairs'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:48:16.163945 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-daec697c-3a81-4fa5-9ab3-9125527943ce tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.351033 Jul 28 10:48:16.164544 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 525/1068] 10.222.0.25 () {60 vars in 1158 bytes} [Wed Jul 28 10:48:15 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:33.439784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1900041699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2074491997", "security_groups": [{"name": "tempest-secgroup-smoke-390804751"}], "block_device_mapping_v2": [{"uuid": "3d087b47-0072-4a2d-b2d1-3303e10451e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fe08e7-640a-41c7-a2ce-93635cb09326"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:33.540293 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] validate_networks() for [('b2fe08e7-640a-41c7-a2ce-93635cb09326', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:48:33.904665 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:48:33.905132 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:48:33.905595 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:48:33.906024 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:48:33.906426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:48:33.915640 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:33.916075 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:33.916900 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:33.917328 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:33.932969 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for project 6525d100052a4861b65a019a6d374764. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:48:33.936787 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for user f6e6f8b50b874ec882ed7e661fc6f831 and project 6525d100052a4861b65a019a6d374764. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:48:33.998012 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:48:34.000177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d087b47-0072-4a2d-b2d1-3303e10451e5',volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:48:34.120736 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6577ee9e-e4c3-4696-9bbc-6017dcd926ac tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.685176 Jul 28 10:48:34.122013 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 544/1069] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:48:33 2021] POST /compute/v2.1/servers => generated 405 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:48:34.133044 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d54c786d-7278-434d-8302-2eeab006c47a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:34.133662 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d54c786d-7278-434d-8302-2eeab006c47a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:34.184909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-d54c786d-7278-434d-8302-2eeab006c47a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:34.191975 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d54c786d-7278-434d-8302-2eeab006c47a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1095 microversion: 2.1 time: 0.064034 Jul 28 10:48:34.192582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 526/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:34 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:35.208241 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1555ff39-10e5-4cf6-bfae-f1b39a26a141 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:35.209003 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1555ff39-10e5-4cf6-bfae-f1b39a26a141 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:35.260474 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1555ff39-10e5-4cf6-bfae-f1b39a26a141 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:35.266870 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1555ff39-10e5-4cf6-bfae-f1b39a26a141 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1095 microversion: 2.1 time: 0.063008 Jul 28 10:48:35.267426 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 545/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:35 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:36.283938 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:36.284554 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:36.290794 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:36.291273 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:36.292042 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:36.292478 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:36.349943 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:36.357209 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-fdfbd4a6-2abf-481c-8ecf-940a90b4e23b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1145 microversion: 2.1 time: 0.076938 Jul 28 10:48:36.357775 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 527/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:36 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1145 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:37.374172 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:37.374787 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:37.380948 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:37.381394 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:37.382165 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:37.382610 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:37.469736 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:37.477070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3e1e08c7-d8ea-4180-801d-d6f430756ed5 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1211 microversion: 2.1 time: 0.106692 Jul 28 10:48:37.477639 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 546/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:37 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:48:38.495003 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:38.496261 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:38.502331 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:38.502877 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:38.503756 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:38.504271 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:38.643468 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:38.652877 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-1f0c0483-c749-4ddc-8cc2-7f7a12f34700 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.162543 Jul 28 10:48:38.653901 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 528/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:38 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:38.699564 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-20858f95-97aa-4596-b3b3-ac28f5c00a2e req-3d536e13-e304-439a-b668-6c4d2181be34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8972cee3-3a3f-4931-9f3e-5505dbb1c63c", "tag": "4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:38.701290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:48:38.701290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:48:38.710374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-20858f95-97aa-4596-b3b3-ac28f5c00a2e req-3d536e13-e304-439a-b668-6c4d2181be34 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:38.711249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-20858f95-97aa-4596-b3b3-ac28f5c00a2e req-3d536e13-e304-439a-b668-6c4d2181be34 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:38.722694 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-20858f95-97aa-4596-b3b3-ac28f5c00a2e req-3d536e13-e304-439a-b668-6c4d2181be34 service nova] Creating event network-changed:4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6 for instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c on hv-cinder-80043 Jul 28 10:48:38.728142 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-20858f95-97aa-4596-b3b3-ac28f5c00a2e req-3d536e13-e304-439a-b668-6c4d2181be34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121292 Jul 28 10:48:38.728765 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 547/1075] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:48:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:48:39.670933 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:39.671543 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:39.677945 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:39.678386 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:39.679150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:39.679584 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:39.798916 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:39.807028 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ac64e6ac-9104-4b9c-bebc-9fa4ba44cb7a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.139732 Jul 28 10:48:39.807593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 529/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:39 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:40.824531 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:40.825256 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:40.831303 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:40.831749 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:40.833339 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:40.833780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:40.956717 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:40.964641 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e5f02276-0ac3-4df1-bfa7-d69052c2e2ea tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.144078 Jul 28 10:48:40.965258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 548/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:40 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:41.980421 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:41.981061 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:41.986882 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:41.987321 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:41.988465 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:41.988955 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:42.107504 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:42.114717 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0e4fc8d9-e1f4-45f1-bd9d-85e7a5c4c80a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.137921 Jul 28 10:48:42.115276 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 530/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:41 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:43.130718 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:43.131330 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:43.137149 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:43.137598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:43.138358 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:43.138796 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:43.256307 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:43.263475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-d75d2346-9bb2-462d-8adb-2d72945fde54 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.136422 Jul 28 10:48:43.264029 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 549/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:43 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:44.280411 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:44.281068 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:44.287266 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:44.287716 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:44.288505 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:44.288977 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:44.405802 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:44.413641 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-ae07c999-15fd-4da8-9faa-61254320a0f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.136895 Jul 28 10:48:44.414205 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 531/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:44 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:45.429590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:45.430205 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:45.436064 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:45.436510 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:45.437317 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:45.437758 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:45.554719 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:45.561977 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-75abc3bc-c7ad-4d6b-b0a7-a99347b48085 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.136096 Jul 28 10:48:45.562549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 550/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:45 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:46.579231 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:46.579783 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:46.585688 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:46.586134 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:46.586893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:46.587323 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:46.709583 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:46.717030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-434a1cc8-e511-43fe-ba6a-0d4ab958fc46 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.141497 Jul 28 10:48:46.717593 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 532/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:46 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:47.379090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:48:47.379338 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:48:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:48:47.734173 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:47.734795 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:47.741552 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:47.742008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:47.742777 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:47.743217 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:47.864321 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:47.872081 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e5b9af3a-fee4-47e5-a4f3-4045c06a9b13 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.141557 Jul 28 10:48:47.872645 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 551/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:47 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:48.088291 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-b19549d3-0518-40cf-a229-6e4b5588e4f5 req-7ecc9feb-cfc2-494f-aae9-a37d8cd271ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8972cee3-3a3f-4931-9f3e-5505dbb1c63c", "name": "network-vif-plugged", "status": "completed", "tag": "4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:48.089967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:48:48.089967 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:48:48.096643 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-b19549d3-0518-40cf-a229-6e4b5588e4f5 req-7ecc9feb-cfc2-494f-aae9-a37d8cd271ba service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:48.097114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-b19549d3-0518-40cf-a229-6e4b5588e4f5 req-7ecc9feb-cfc2-494f-aae9-a37d8cd271ba service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:48.108681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-b19549d3-0518-40cf-a229-6e4b5588e4f5 req-7ecc9feb-cfc2-494f-aae9-a37d8cd271ba service nova] Creating event network-vif-plugged:4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6 for instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c on hv-cinder-80043 Jul 28 10:48:48.113563 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-b19549d3-0518-40cf-a229-6e4b5588e4f5 req-7ecc9feb-cfc2-494f-aae9-a37d8cd271ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081455 Jul 28 10:48:48.114137 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 533/1084] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:48:48.888627 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:48.889258 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:48.895097 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:48.895533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:48.897028 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:48.897457 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:49.013716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:49.021550 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-0ef774b1-bb6c-4e1d-a9b0-32bbc21af5ab tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1266 microversion: 2.1 time: 0.135950 Jul 28 10:48:49.022117 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 552/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:48 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:50.039781 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:50.040402 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:50.046581 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:50.047030 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:50.047798 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:50.048236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:50.168274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:50.175546 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-29c09753-7e59-412d-a485-d93633cde1af tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1452 microversion: 2.1 time: 0.140666 Jul 28 10:48:50.176115 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 534/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:50 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:50.191600 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:48:50.192204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:48:50.198312 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:50.198753 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:50.199508 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:50.199939 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:50.322705 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:48:50.329934 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-3f0ec748-d77d-4a5f-b469-b4d1f8e1fa23 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1452 microversion: 2.1 time: 0.142063 Jul 28 10:48:50.330531 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 553/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:48:50 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:48:51.965835 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-3b300ec5-f1fe-47bf-a5b5-63b3069b71fe req-58a00967-2e4f-44e0-9d13-3b7f76796195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8972cee3-3a3f-4931-9f3e-5505dbb1c63c", "tag": "4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:48:51.967321 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:48:51.967321 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:48:51.974377 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-3b300ec5-f1fe-47bf-a5b5-63b3069b71fe req-58a00967-2e4f-44e0-9d13-3b7f76796195 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:48:51.974893 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-3b300ec5-f1fe-47bf-a5b5-63b3069b71fe req-58a00967-2e4f-44e0-9d13-3b7f76796195 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:48:51.985392 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-3b300ec5-f1fe-47bf-a5b5-63b3069b71fe req-58a00967-2e4f-44e0-9d13-3b7f76796195 service nova] Creating event network-changed:4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6 for instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c on hv-cinder-80043 Jul 28 10:48:51.990322 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-3b300ec5-f1fe-47bf-a5b5-63b3069b71fe req-58a00967-2e4f-44e0-9d13-3b7f76796195 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028141 Jul 28 10:48:51.990900 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 535/1088] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:48:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:50:38.808141 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:50:38.808830 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:50:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:50:42.599875 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:50:42.600348 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: Wed Jul 28 10:50:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:50:47.412728 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:47.413415 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:47.419824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:47.420278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:47.421137 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:47.421573 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:47.446916 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Going to try to terminate instance {{(pid=119120) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:50:47.523250 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ebf25d8c-0d2a-429c-aa09-af0ddc958678 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 204 len: 0 microversion: 2.1 time: 0.114789 Jul 28 10:50:47.526923 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 554/1089] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:50:47 2021] DELETE /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:50:47.534611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:47.535302 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:47.542222 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:47.542662 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:47.543420 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:47.543847 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:47.671114 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:47.678524 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-7ce63bf3-bb3d-4aba-bc25-faa18220259a tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1577 microversion: 2.1 time: 0.150297 Jul 28 10:50:47.679070 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 536/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:47 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:50:48.695761 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:48.696391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:48.702461 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:48.702910 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:48.703683 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:48.704120 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:48.825750 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:48.833862 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-12a77e07-9564-4635-bc7a-ceda2acea685 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1577 microversion: 2.1 time: 0.142235 Jul 28 10:50:48.834437 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 555/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:48 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1577 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:49.850727 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:49.851378 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:49.857455 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:49.857899 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:49.858662 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:49.859092 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:49.918792 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:49.926075 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-51e93e6c-6c90-448b-8c9c-105728b69e1c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1510 microversion: 2.1 time: 0.079118 Jul 28 10:50:49.926634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 537/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:49 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1510 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:50.065060 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a8e605d-3fb3-4270-9825-b57c81bf7e2c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 10:50:50.068434 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-a3af3e40-0932-4de8-bffa-a6e8f5245783 req-23a98a5a-e19f-4462-b84b-420f8915636d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8972cee3-3a3f-4931-9f3e-5505dbb1c63c", "name": "network-vif-deleted", "tag": "4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:50:50.069944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:50:50.069944 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:50:50.077756 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-a3af3e40-0932-4de8-bffa-a6e8f5245783 req-23a98a5a-e19f-4462-b84b-420f8915636d service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:50.078189 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-a3af3e40-0932-4de8-bffa-a6e8f5245783 req-23a98a5a-e19f-4462-b84b-420f8915636d service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:50.089005 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-a3af3e40-0932-4de8-bffa-a6e8f5245783 req-23a98a5a-e19f-4462-b84b-420f8915636d service nova] Creating event network-vif-deleted:4a9cb3f5-3b58-4d60-a789-c4c8e509a6b6 for instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c on hv-cinder-80043 Jul 28 10:50:50.094092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-a3af3e40-0932-4de8-bffa-a6e8f5245783 req-23a98a5a-e19f-4462-b84b-420f8915636d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030251 Jul 28 10:50:50.094799 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 556/1093] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:50:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:50:50.942940 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:50.943547 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:50.949693 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:50.950118 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:50.950910 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:50.951309 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:50.983263 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:50.983702 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:50.984145 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.objects.instance [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lazy-loading 'fault' on Instance uuid 8972cee3-3a3f-4931-9f3e-5505dbb1c63c {{(pid=119121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 10:50:51.023619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:51.032429 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-312b83a1-fbec-491c-8db6-0aaac61b20a2 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 200 len: 1231 microversion: 2.1 time: 0.092753 Jul 28 10:50:51.038560 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 538/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:50 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:52.067974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:52.068670 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:52.070892 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a8e605d-3fb3-4270-9825-b57c81bf7e2c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34532. Jul 28 10:50:52.075834 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:52.076279 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:52.077070 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:52.077507 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:52.090499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] HTTP exception thrown: Instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c could not be found. Jul 28 10:50:52.091085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Returning 404 to user: Instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:50:52.091895 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bb4a230f-3b5e-46cb-89b5-2a57ddf3bc06 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 404 len: 111 microversion: 2.1 time: 0.045289 Jul 28 10:50:52.092425 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 557/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:52 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:50:52.134352 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e1d687f-4011-41b6-a34b-21fabf1e2853] AMQP server on 10.222.0.25:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 28 10:50:52.137611 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1085934460", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2074491997", "security_groups": [{"name": "tempest-secgroup-smoke-390804751"}], "block_device_mapping_v2": [{"uuid": "3d087b47-0072-4a2d-b2d1-3303e10451e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fe08e7-640a-41c7-a2ce-93635cb09326"}]}} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:50:52.236988 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.network.neutron [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] validate_networks() for [('b2fe08e7-640a-41c7-a2ce-93635cb09326', None, None, None)] {{(pid=119121) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:50:52.609002 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Flavor limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:50:52.609422 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Image limits 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:50:52.609898 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Flavor pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:50:52.610300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Image pref 0:0:0 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:50:52.610705 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.virt.hardware [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:50:52.620815 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:52.621264 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:52.622057 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:52.622488 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:52.638730 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for project 6525d100052a4861b65a019a6d374764. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:50:52.642582 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.quota [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for user f6e6f8b50b874ec882ed7e661fc6f831 and project 6525d100052a4861b65a019a6d374764. Resources: {'cores', 'instances', 'ram'} {{(pid=119121) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:50:52.701649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Going to run 1 instances... {{(pid=119121) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:50:52.703755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d087b47-0072-4a2d-b2d1-3303e10451e5',volume_size=None,volume_type=None)] {{(pid=119121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:50:52.823577 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5696925d-faff-4c54-b576-522dbd66497b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.690052 Jul 28 10:50:52.824217 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 539/1096] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:50:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:50:52.836401 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1280398d-04e8-4699-90fc-bf162cda6ba7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:52.837035 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1280398d-04e8-4699-90fc-bf162cda6ba7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:52.889558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1280398d-04e8-4699-90fc-bf162cda6ba7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:52.895957 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1280398d-04e8-4699-90fc-bf162cda6ba7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1095 microversion: 2.1 time: 0.063194 Jul 28 10:50:52.896625 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 558/1097] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:52 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:53.912352 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:53.912997 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:53.930347 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:53.930809 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:53.932133 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:53.932577 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:53.957676 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e1d687f-4011-41b6-a34b-21fabf1e2853] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34560. Jul 28 10:50:53.996585 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:54.004185 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8a605752-11ed-4ca7-81ea-e36af21b78fb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1211 microversion: 2.1 time: 0.095400 Jul 28 10:50:54.004778 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 540/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:53 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:55.020855 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:55.021471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:55.030178 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:55.030748 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:55.031653 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:55.032157 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:55.105263 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-bc527ed6-308a-4c4e-92f3-1fb71555e607 req-516623f8-39c2-4032-b068-5dd960972865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa778be-4a2d-4af1-b348-7afe4d1a4757", "tag": "f0783867-c9d9-4c64-b2f6-458f9d93d058"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:50:55.107677 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:50:55.107677 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:50:55.115357 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-bc527ed6-308a-4c4e-92f3-1fb71555e607 req-516623f8-39c2-4032-b068-5dd960972865 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:55.115952 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-bc527ed6-308a-4c4e-92f3-1fb71555e607 req-516623f8-39c2-4032-b068-5dd960972865 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:55.128591 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-bc527ed6-308a-4c4e-92f3-1fb71555e607 req-516623f8-39c2-4032-b068-5dd960972865 service nova] Creating event network-changed:f0783867-c9d9-4c64-b2f6-458f9d93d058 for instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 on hv-cinder-80043 Jul 28 10:50:55.133684 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-bc527ed6-308a-4c4e-92f3-1fb71555e607 req-516623f8-39c2-4032-b068-5dd960972865 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Jul 28 10:50:55.134805 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 541/1099] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:50:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:50:55.250252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:55.258374 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-23c0867c-e5a6-49bf-8d07-66da09dfa889 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.241647 Jul 28 10:50:55.259262 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 559/1100] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:55 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:56.275982 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:56.276606 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:56.282617 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:56.283073 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:56.283852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:56.284293 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:56.405269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:56.412497 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-68548b7d-5485-4861-8f3f-9beb5e513b84 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.141202 Jul 28 10:50:56.413180 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 542/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:56 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:57.429223 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:57.429827 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:57.436296 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:57.436739 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:57.437594 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:57.438026 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:57.559342 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:57.567230 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-bcfbbd0f-0de6-4522-a4f0-d5228a93bc69 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.141597 Jul 28 10:50:57.567831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 560/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:57 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:58.584654 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:58.585319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:58.592299 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:58.592741 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:58.593532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:58.593959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:58.730132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:58.740222 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-69f32fb8-da83-47a5-8a22-0a73e2a60020 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.159873 Jul 28 10:50:58.740802 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 543/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:58 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:50:59.758800 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:50:59.760158 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:50:59.766194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:59.766643 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:59.767411 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:50:59.767845 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:50:59.883824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:50:59.891839 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-e5539bf6-c100-4d82-b28c-641a6977d344 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.136719 Jul 28 10:50:59.892410 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 561/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:50:59 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:00.908646 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:00.909280 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:00.915131 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:00.915861 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:00.916629 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:00.917097 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:01.036439 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:01.044095 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-50b5a908-8bd4-4066-ad77-bcffce6fd2cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.139107 Jul 28 10:51:01.044661 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 544/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:00 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:02.060079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:02.060693 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:02.066561 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:02.067003 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:02.067769 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:02.068204 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:02.187009 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:02.194094 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-f6dbe25a-78db-43ce-bbcc-e1b649410640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.137735 Jul 28 10:51:02.194648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 562/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:02 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:03.211000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:03.211607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:03.217671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:03.218143 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:03.218896 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:03.219323 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:03.334484 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:03.341640 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5f571ad6-f000-4d4f-b40a-022f74881153 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.134263 Jul 28 10:51:03.342200 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 545/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:03 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:04.358876 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:04.359484 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:04.365366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:04.365812 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:04.366575 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:04.367038 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:04.490742 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:04.498251 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7ee3884a-68e2-46d4-b6c0-08d560fa93a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.143051 Jul 28 10:51:04.498831 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 563/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:04 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:04.586408 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-af802d5e-34aa-4a92-95a4-9e8bb3c46441 req-eb4a50d0-68c6-4375-9018-5dd21ff6e2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa778be-4a2d-4af1-b348-7afe4d1a4757", "name": "network-vif-plugged", "status": "completed", "tag": "f0783867-c9d9-4c64-b2f6-458f9d93d058"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:04.588884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:51:04.588884 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:51:04.596122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-af802d5e-34aa-4a92-95a4-9e8bb3c46441 req-eb4a50d0-68c6-4375-9018-5dd21ff6e2fe service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:04.596571 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-af802d5e-34aa-4a92-95a4-9e8bb3c46441 req-eb4a50d0-68c6-4375-9018-5dd21ff6e2fe service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:04.608851 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-af802d5e-34aa-4a92-95a4-9e8bb3c46441 req-eb4a50d0-68c6-4375-9018-5dd21ff6e2fe service nova] Creating event network-vif-plugged:f0783867-c9d9-4c64-b2f6-458f9d93d058 for instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 on hv-cinder-80043 Jul 28 10:51:04.613793 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-af802d5e-34aa-4a92-95a4-9e8bb3c46441 req-eb4a50d0-68c6-4375-9018-5dd21ff6e2fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 Jul 28 10:51:04.614503 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 546/1109] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:51:05.515128 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:05.515743 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:05.521669 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:05.522122 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:05.522891 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:05.523328 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:05.640010 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:05.647249 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-ec94ee6c-b4c8-4c31-97ce-b4e56f27e79b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1266 microversion: 2.1 time: 0.135741 Jul 28 10:51:05.647824 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 564/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:05 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:06.664493 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:06.665153 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:06.671603 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:06.672047 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:06.672825 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:06.673257 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:06.793667 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:06.800955 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5c38b0f3-bbbb-4fc8-b58e-726ab5d5e360 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1453 microversion: 2.1 time: 0.140475 Jul 28 10:51:06.801528 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 547/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:06 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:06.817479 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:51:06.818085 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:51:06.824695 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:06.825167 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:06.825927 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:06.826358 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:06.946391 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:51:06.953667 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-a254a967-c71d-4e1d-9c3d-b4fcaf191ebc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1453 microversion: 2.1 time: 0.139816 Jul 28 10:51:06.954234 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 565/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:51:06 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:51:08.762319 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [req-90048d51-3d92-4e7f-a24b-724f62fe5dcb req-a55e6e37-005c-40a8-8a4c-25265e667950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa778be-4a2d-4af1-b348-7afe4d1a4757", "tag": "f0783867-c9d9-4c64-b2f6-458f9d93d058"}]} {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:51:08.763888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:51:08.763888 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: warnings.warn(msg) Jul 28 10:51:08.770800 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-90048d51-3d92-4e7f-a24b-724f62fe5dcb req-a55e6e37-005c-40a8-8a4c-25265e667950 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:51:08.771234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [req-90048d51-3d92-4e7f-a24b-724f62fe5dcb req-a55e6e37-005c-40a8-8a4c-25265e667950 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:51:08.782688 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.compute.server_external_events [req-90048d51-3d92-4e7f-a24b-724f62fe5dcb req-a55e6e37-005c-40a8-8a4c-25265e667950 service nova] Creating event network-changed:f0783867-c9d9-4c64-b2f6-458f9d93d058 for instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 on hv-cinder-80043 Jul 28 10:51:08.787543 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [req-90048d51-3d92-4e7f-a24b-724f62fe5dcb req-a55e6e37-005c-40a8-8a4c-25265e667950 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029823 Jul 28 10:51:08.788132 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 548/1113] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:51:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:52:46.729716 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2080821606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2074491997", "security_groups": [{"name": "tempest-secgroup-smoke-390804751"}], "block_device_mapping_v2": [{"uuid": "77947e29-f72c-4b1f-b7f5-b50da24a2266", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2fe08e7-640a-41c7-a2ce-93635cb09326"}]}} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:52:46.970636 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.network.neutron [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] validate_networks() for [('b2fe08e7-640a-41c7-a2ce-93635cb09326', None, None, None)] {{(pid=119120) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 10:52:47.387366 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Flavor limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 10:52:47.387784 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Image limits 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 10:52:47.388280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Flavor pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 10:52:47.388680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Image pref 0:0:0 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 10:52:47.389212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.virt.hardware [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 10:52:47.398529 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:47.398997 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:47.399778 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:47.400201 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:47.417780 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for project 6525d100052a4861b65a019a6d374764. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 10:52:47.421600 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.quota [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Getting quotas for user f6e6f8b50b874ec882ed7e661fc6f831 and project 6525d100052a4861b65a019a6d374764. Resources: {'cores', 'instances', 'ram'} {{(pid=119120) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 10:52:47.481590 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Going to run 1 instances... {{(pid=119120) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 10:52:47.483711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77947e29-f72c-4b1f-b7f5-b50da24a2266',volume_size=None,volume_type=None)] {{(pid=119120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 10:52:47.599486 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [48f37438-4126-4d75-a027-78a9283efd3c] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 10:52:48.616532 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [48f37438-4126-4d75-a027-78a9283efd3c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34670. Jul 28 10:52:48.620280 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1cddea1e-ac96-4899-a963-454a7b66f6ad tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.895137 Jul 28 10:52:48.620952 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 566/1114] 10.222.0.25 () {60 vars in 1147 bytes} [Wed Jul 28 10:52:46 2021] POST /compute/v2.1/servers => generated 405 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 10:52:48.632404 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-8a9931ea-7fba-46df-bf96-f55d36ad7083 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:48.633696 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-8a9931ea-7fba-46df-bf96-f55d36ad7083 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:48.742634 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-8a9931ea-7fba-46df-bf96-f55d36ad7083 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:48.749277 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-8a9931ea-7fba-46df-bf96-f55d36ad7083 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1095 microversion: 2.1 time: 0.122160 Jul 28 10:52:48.750130 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 549/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:48 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1095 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:49.767232 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:49.767850 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:49.775012 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:49.775462 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:49.776245 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:49.776680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:49.848649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:49.855889 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c2dc4642-07fb-4abd-a559-fe946495d2a9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1211 microversion: 2.1 time: 0.092386 Jul 28 10:52:49.856388 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 567/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:49 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:50.872658 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:50.873401 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:50.879822 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:50.880274 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:50.881090 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:50.881648 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:50.899887 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-c95cee74-7b66-4d2e-9c2b-899c78593680 req-a62f2a79-efba-41fa-8ade-a7620d8689d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32169528-0f14-4079-ba9f-a0a58c2d6442", "tag": "976556c6-f776-4556-b3ac-79f46ae67c74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:52:50.901471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:52:50.901471 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:52:50.910724 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c95cee74-7b66-4d2e-9c2b-899c78593680 req-a62f2a79-efba-41fa-8ade-a7620d8689d3 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:50.911233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c95cee74-7b66-4d2e-9c2b-899c78593680 req-a62f2a79-efba-41fa-8ade-a7620d8689d3 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:50.931314 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-c95cee74-7b66-4d2e-9c2b-899c78593680 req-a62f2a79-efba-41fa-8ade-a7620d8689d3 service nova] Creating event network-changed:976556c6-f776-4556-b3ac-79f46ae67c74 for instance 32169528-0f14-4079-ba9f-a0a58c2d6442 on hv-cinder-80043 Jul 28 10:52:50.936649 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-c95cee74-7b66-4d2e-9c2b-899c78593680 req-a62f2a79-efba-41fa-8ade-a7620d8689d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040324 Jul 28 10:52:50.937451 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 568/1117] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:52:51.035858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:51.043940 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a5912bcc-d09f-4b85-a70c-829c1c1a33fe tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.174887 Jul 28 10:52:51.044513 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 550/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:50 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:52.061003 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:52.061778 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:52.069521 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:52.069959 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:52.070723 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:52.071154 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:52.193812 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:52.201040 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-7092392d-f69e-425a-ae56-c146fc4c468c tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.143996 Jul 28 10:52:52.201596 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 569/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:52 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:53.221000 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:53.222140 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:53.227909 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:53.228351 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:53.229133 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:53.229566 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:53.350617 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:53.357857 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-71b0d1d9-0570-403e-8724-a174dbc949f0 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.140579 Jul 28 10:52:53.358417 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 551/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:53 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:54.375062 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:54.375668 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:54.382470 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:54.382911 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:54.383656 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:54.384084 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:54.503409 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:54.510878 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-186613e4-488b-4873-888f-1f7ab7336da9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.139493 Jul 28 10:52:54.511439 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 570/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:54 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:55.528245 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:55.528969 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:55.535376 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:55.535814 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:55.536566 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:55.537021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:55.652937 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:55.660935 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-b4519221-83bf-4188-a7a4-813187765d49 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.136571 Jul 28 10:52:55.661496 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 552/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:55 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:56.678175 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:56.678794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:56.684672 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:56.685151 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:56.685925 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:56.686371 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:56.804270 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:56.811469 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-6edab74c-5e1f-48d2-833d-e33837f870cb tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.137755 Jul 28 10:52:56.812033 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 571/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:56 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:57.828350 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:57.829021 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:57.835360 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:57.835799 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:57.836549 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:57.837003 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:57.953473 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:57.961122 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-720e958c-f32f-4adc-b067-fa64f44fe640 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.136332 Jul 28 10:52:57.961619 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 553/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:57 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:52:58.978130 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:52:58.978743 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:52:58.984598 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:58.985065 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:58.985826 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:52:58.986252 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:52:59.105040 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:52:59.112171 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-180c7958-3caf-4c91-81da-a966c0eaa042 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.138050 Jul 28 10:52:59.112707 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 572/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:52:58 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:00.129150 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:00.130080 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:53:00.135996 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:00.136446 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:00.137237 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:00.137671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:00.259734 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:00.266953 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-a7d30587-2ca5-409a-a6b3-8a3a9f938cb1 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.141681 Jul 28 10:53:00.267506 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 554/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:53:00 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:01.283473 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:01.284640 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:53:01.290837 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:01.291278 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:01.292119 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:01.292549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:01.420235 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:01.428142 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-c57954b4-39c4-4d56-b137-e1e5b87a53dc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.148301 Jul 28 10:53:01.428707 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 573/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:53:01 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:02.445424 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:02.446024 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:53:02.452246 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:02.452692 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:02.453477 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:02.453921 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:02.571185 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:02.578385 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-00c6675a-a3e0-4023-8ddd-c394fd7bf7b3 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.136611 Jul 28 10:53:02.578954 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 555/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:53:02 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:03.091558 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-c6549dab-0d25-42a8-a9de-145d97b1a2e1 req-e183ca29-36b7-4f91-b93f-2d3b70ca73d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32169528-0f14-4079-ba9f-a0a58c2d6442", "name": "network-vif-plugged", "status": "completed", "tag": "976556c6-f776-4556-b3ac-79f46ae67c74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:53:03.093123 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:53:03.093123 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:53:03.100791 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c6549dab-0d25-42a8-a9de-145d97b1a2e1 req-e183ca29-36b7-4f91-b93f-2d3b70ca73d8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:03.101233 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-c6549dab-0d25-42a8-a9de-145d97b1a2e1 req-e183ca29-36b7-4f91-b93f-2d3b70ca73d8 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:03.112134 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-c6549dab-0d25-42a8-a9de-145d97b1a2e1 req-e183ca29-36b7-4f91-b93f-2d3b70ca73d8 service nova] Creating event network-vif-plugged:976556c6-f776-4556-b3ac-79f46ae67c74 for instance 32169528-0f14-4079-ba9f-a0a58c2d6442 on hv-cinder-80043 Jul 28 10:53:03.117032 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-c6549dab-0d25-42a8-a9de-145d97b1a2e1 req-e183ca29-36b7-4f91-b93f-2d3b70ca73d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029045 Jul 28 10:53:03.117798 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 574/1129] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:53:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:53:03.594426 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:03.595042 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:53:03.601260 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:03.601711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:03.602485 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:03.602925 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:03.721458 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:03.729525 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-960a71c8-34bc-43b4-a209-54f2c7c41897 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1266 microversion: 2.1 time: 0.138719 Jul 28 10:53:03.730086 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 556/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:53:03 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:04.746916 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:04.747533 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:53:04.754626 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:04.755328 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:04.756092 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:04.756520 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:04.875362 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:04.883619 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-9f690352-7538-4fbc-a049-37f91fee6ccc tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1452 microversion: 2.1 time: 0.140770 Jul 28 10:53:04.884181 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 575/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:53:04 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:04.899745 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:53:04.900358 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:53:04.906542 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:04.906991 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:04.907755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:04.908191 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:05.028914 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:53:05.036649 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-77f16da2-938e-4e1a-819f-4420b9d56b85 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1452 microversion: 2.1 time: 0.140574 Jul 28 10:53:05.037236 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 557/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:53:04 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:53:06.881794 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-ffa49e7d-15e6-42e6-aac9-4d84729d6bb7 req-ab5aba17-936c-44bd-a15d-d47d91fd96b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32169528-0f14-4079-ba9f-a0a58c2d6442", "tag": "976556c6-f776-4556-b3ac-79f46ae67c74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:53:06.883815 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:53:06.883815 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:53:06.891532 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-ffa49e7d-15e6-42e6-aac9-4d84729d6bb7 req-ab5aba17-936c-44bd-a15d-d47d91fd96b7 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:53:06.891974 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-ffa49e7d-15e6-42e6-aac9-4d84729d6bb7 req-ab5aba17-936c-44bd-a15d-d47d91fd96b7 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:53:06.904475 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-ffa49e7d-15e6-42e6-aac9-4d84729d6bb7 req-ab5aba17-936c-44bd-a15d-d47d91fd96b7 service nova] Creating event network-changed:976556c6-f776-4556-b3ac-79f46ae67c74 for instance 32169528-0f14-4079-ba9f-a0a58c2d6442 on hv-cinder-80043 Jul 28 10:53:06.910926 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-ffa49e7d-15e6-42e6-aac9-4d84729d6bb7 req-ab5aba17-936c-44bd-a15d-d47d91fd96b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087770 Jul 28 10:53:06.911536 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 576/1133] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:53:47.398760 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:53:47.399367 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:53:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:53:58.825926 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:53:58.826588 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:53:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:54:02.618272 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:54:02.618736 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: Wed Jul 28 10:54:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:54:09.007607 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:54:09.008113 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:54:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:54:46.531125 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6a8e605d-3fb3-4270-9825-b57c81bf7e2c] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 10:54:46.534948 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:46.535532 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:46.538785 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-66a26a9a-0b79-45c8-979e-366e024875e2 req-bff68c52-36da-4306-83b1-4cb39f3caad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32169528-0f14-4079-ba9f-a0a58c2d6442", "tag": "976556c6-f776-4556-b3ac-79f46ae67c74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:46.540334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:54:46.540334 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:54:46.541949 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:46.542471 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:46.543431 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:46.544031 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:46.547629 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-66a26a9a-0b79-45c8-979e-366e024875e2 req-bff68c52-36da-4306-83b1-4cb39f3caad7 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:46.548079 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-66a26a9a-0b79-45c8-979e-366e024875e2 req-bff68c52-36da-4306-83b1-4cb39f3caad7 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:46.559888 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-66a26a9a-0b79-45c8-979e-366e024875e2 req-bff68c52-36da-4306-83b1-4cb39f3caad7 service nova] Creating event network-changed:976556c6-f776-4556-b3ac-79f46ae67c74 for instance 32169528-0f14-4079-ba9f-a0a58c2d6442 on hv-cinder-80043 Jul 28 10:54:46.565150 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-66a26a9a-0b79-45c8-979e-366e024875e2 req-bff68c52-36da-4306-83b1-4cb39f3caad7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035912 Jul 28 10:54:46.565776 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 577/1134] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:54:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:54:46.569866 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:54:46.659959 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-034731a8-fa65-42ec-88e9-21649c641db7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "DELETE /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 204 len: 0 microversion: 2.1 time: 0.133713 Jul 28 10:54:46.660548 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 558/1135] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:54:46 2021] DELETE /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:54:46.669648 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:46.670361 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:46.676549 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:46.677036 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:46.677815 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:46.678407 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:46.875642 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:46.883710 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-1e8b4f39-b3fc-4c33-af96-e42ae3a468f7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1577 microversion: 2.1 time: 0.218538 Jul 28 10:54:46.894200 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 578/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:46 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:47.902221 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:47.902915 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:47.908711 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:47.909197 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:47.909962 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:47.910398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:48.034480 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:48.043342 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e28f8b5a-9f00-4797-bc93-ff2b85b92774 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1458 microversion: 2.1 time: 0.145829 Jul 28 10:54:48.043916 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 559/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:47 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1458 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:48.886905 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] [6a8e605d-3fb3-4270-9825-b57c81bf7e2c] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34798. Jul 28 10:54:48.921256 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-308d08e6-b015-4703-bd62-5fbd22bfc218 req-e523d87c-1404-4f9c-a333-5b7dda5bc79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32169528-0f14-4079-ba9f-a0a58c2d6442", "name": "network-vif-deleted", "tag": "976556c6-f776-4556-b3ac-79f46ae67c74"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:48.922752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:54:48.922752 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:54:48.929678 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-308d08e6-b015-4703-bd62-5fbd22bfc218 req-e523d87c-1404-4f9c-a333-5b7dda5bc79f service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:48.930113 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-308d08e6-b015-4703-bd62-5fbd22bfc218 req-e523d87c-1404-4f9c-a333-5b7dda5bc79f service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:48.945862 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-308d08e6-b015-4703-bd62-5fbd22bfc218 req-e523d87c-1404-4f9c-a333-5b7dda5bc79f service nova] Creating event network-vif-deleted:976556c6-f776-4556-b3ac-79f46ae67c74 for instance 32169528-0f14-4079-ba9f-a0a58c2d6442 on hv-cinder-80043 Jul 28 10:54:48.951774 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-308d08e6-b015-4703-bd62-5fbd22bfc218 req-e523d87c-1404-4f9c-a333-5b7dda5bc79f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092294 Jul 28 10:54:48.952358 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 579/1138] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:54:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:54:49.061065 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:49.061681 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:49.067613 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:49.068063 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:49.068858 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:49.069340 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:49.127087 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:49.134974 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-5f7f4e9c-5e32-4c6f-86af-964d2cba5d7d tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 200 len: 1226 microversion: 2.1 time: 0.077517 Jul 28 10:54:49.136436 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 560/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:49 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:50.153856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:50.154587 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 32169528-0f14-4079-ba9f-a0a58c2d6442] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:50.160635 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:50.161112 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:50.161869 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:50.162302 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:50.175720 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] HTTP exception thrown: Instance 32169528-0f14-4079-ba9f-a0a58c2d6442 could not be found. Jul 28 10:54:50.176290 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Returning 404 to user: Instance 32169528-0f14-4079-ba9f-a0a58c2d6442 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:54:50.177140 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-8511f6b0-b032-4d6d-82c3-19176878fe7b tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442" status: 404 len: 111 microversion: 2.1 time: 0.027907 Jul 28 10:54:50.177666 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 580/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:50 2021] GET /compute/v2.1/servers/32169528-0f14-4079-ba9f-a0a58c2d6442 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:54:53.196842 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:53.197362 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:53.199177 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-0708e1cb-4d42-46af-b10f-8d2f192c8cbe req-659eeffd-2eae-4a61-9b8b-fd16dd64c4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa778be-4a2d-4af1-b348-7afe4d1a4757", "tag": "f0783867-c9d9-4c64-b2f6-458f9d93d058"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:53.200762 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:54:53.200762 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:54:53.203212 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:53.203965 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:53.204735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:53.205186 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:53.207771 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0708e1cb-4d42-46af-b10f-8d2f192c8cbe req-659eeffd-2eae-4a61-9b8b-fd16dd64c4ba service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:53.208447 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-0708e1cb-4d42-46af-b10f-8d2f192c8cbe req-659eeffd-2eae-4a61-9b8b-fd16dd64c4ba service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:53.219866 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-0708e1cb-4d42-46af-b10f-8d2f192c8cbe req-659eeffd-2eae-4a61-9b8b-fd16dd64c4ba service nova] Creating event network-changed:f0783867-c9d9-4c64-b2f6-458f9d93d058 for instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 on hv-cinder-80043 Jul 28 10:54:53.224856 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-0708e1cb-4d42-46af-b10f-8d2f192c8cbe req-659eeffd-2eae-4a61-9b8b-fd16dd64c4ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029354 Jul 28 10:54:53.225435 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 581/1141] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:54:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 10:54:53.233078 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Going to try to terminate instance {{(pid=119121) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 10:54:53.314238 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-30eb9af8-5984-4af5-8561-fc0202759c92 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 204 len: 0 microversion: 2.1 time: 0.121132 Jul 28 10:54:53.315300 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 561/1142] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:54:53 2021] DELETE /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 10:54:53.325307 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:53.326518 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:53.332680 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:53.333431 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:53.334212 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:53.334647 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:53.539284 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.policy [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119120) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:53.547818 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-85cdfaa5-ebc8-4ab3-a31b-2ac37dbd1275 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1578 microversion: 2.1 time: 0.227848 Jul 28 10:54:53.548711 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 582/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:53 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:54.562187 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e1d687f-4011-41b6-a34b-21fabf1e2853] AMQP server on 10.222.0.25:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 28 10:54:54.565735 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:54.566425 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:54.572864 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:54.573306 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:54.574070 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:54.574502 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:54.696314 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:54.704234 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-423839b0-b48c-4ef1-8a86-18719fd3c947 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1459 microversion: 2.1 time: 0.143286 Jul 28 10:54:54.704821 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 562/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:54 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1459 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 10:54:55.449061 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [req-5fbb800b-de47-4772-be79-92c7bf46a63d req-faab2089-0411-4e49-bd46-7f091ac5fc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa778be-4a2d-4af1-b348-7afe4d1a4757", "name": "network-vif-deleted", "tag": "f0783867-c9d9-4c64-b2f6-458f9d93d058"}]} {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 10:54:55.451037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 10:54:55.451037 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: warnings.warn(msg) Jul 28 10:54:55.458982 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-5fbb800b-de47-4772-be79-92c7bf46a63d req-faab2089-0411-4e49-bd46-7f091ac5fc03 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:55.459420 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [req-5fbb800b-de47-4772-be79-92c7bf46a63d req-faab2089-0411-4e49-bd46-7f091ac5fc03 service nova] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:55.470317 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.compute.server_external_events [req-5fbb800b-de47-4772-be79-92c7bf46a63d req-faab2089-0411-4e49-bd46-7f091ac5fc03 service nova] Creating event network-vif-deleted:f0783867-c9d9-4c64-b2f6-458f9d93d058 for instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 on hv-cinder-80043 Jul 28 10:54:55.475901 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [req-5fbb800b-de47-4772-be79-92c7bf46a63d req-faab2089-0411-4e49-bd46-7f091ac5fc03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Jul 28 10:54:55.476502 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 583/1145] 10.222.0.25 () {64 vars in 1318 bytes} [Wed Jul 28 10:54:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 10:54:55.720739 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:55.721373 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:55.738710 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:55.739168 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:55.739946 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:55.740381 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:55.747536 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e1d687f-4011-41b6-a34b-21fabf1e2853] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 34836. Jul 28 10:54:55.809268 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.policy [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e6f8b50b874ec882ed7e661fc6f831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6525d100052a4861b65a019a6d374764', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119121) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 10:54:55.817096 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-e5de55c7-b192-4961-8523-6f5f82236d65 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 200 len: 1226 microversion: 2.1 time: 0.099908 Jul 28 10:54:55.817671 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 563/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:55 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 10:54:56.834535 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:56.835264 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 2fa778be-4a2d-4af1-b348-7afe4d1a4757] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:56.842145 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:56.842592 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:56.843356 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:56.843789 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:56.856609 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] HTTP exception thrown: Instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 could not be found. Jul 28 10:54:56.857221 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Returning 404 to user: Instance 2fa778be-4a2d-4af1-b348-7afe4d1a4757 could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:54:56.858027 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-07133b94-e6b7-4991-aa93-1b67f7425fd7 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757" status: 404 len: 111 microversion: 2.1 time: 0.027540 Jul 28 10:54:56.858544 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 584/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:56 2021] GET /compute/v2.1/servers/2fa778be-4a2d-4af1-b348-7afe4d1a4757 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:54:57.300876 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:57.301398 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.compute.api [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119121) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:57.307364 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:57.307807 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:57.308568 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:57.309027 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG oslo_concurrency.lockutils [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:57.322433 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.wsgi [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] HTTP exception thrown: Instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c could not be found. Jul 28 10:54:57.323026 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Returning 404 to user: Instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c could not be found. {{(pid=119121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:54:57.323832 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-d4de7773-1e14-4a80-a3ae-b624a2c31be9 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 404 len: 111 microversion: 2.1 time: 0.027139 Jul 28 10:54:57.324348 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 564/1148] 10.222.0.25 () {58 vars in 1239 bytes} [Wed Jul 28 10:54:57 2021] DELETE /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:54:57.332345 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '>' {{(pid=119120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:57.332991 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.compute.api [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] [instance: 8972cee3-3a3f-4931-9f3e-5505dbb1c63c] Fetching instance by UUID {{(pid=119120) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 10:54:57.339685 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:57.340136 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:57.340940 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 10:54:57.341372 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG oslo_concurrency.lockutils [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Lock "879bb43f-01c6-4672-bf48-025868d9cf22" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 10:54:57.354194 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.wsgi [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] HTTP exception thrown: Instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c could not be found. Jul 28 10:54:57.354773 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: DEBUG nova.api.openstack.wsgi [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Returning 404 to user: Instance 8972cee3-3a3f-4931-9f3e-5505dbb1c63c could not be found. {{(pid=119120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 10:54:57.355580 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO nova.api.openstack.requestlog [None req-55c5a646-5110-44ca-bd17-02b408e8f6a4 tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c" status: 404 len: 111 microversion: 2.1 time: 0.026905 Jul 28 10:54:57.356096 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: [pid: 119120|app: 0|req: 585/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Wed Jul 28 10:54:57 2021] GET /compute/v2.1/servers/8972cee3-3a3f-4931-9f3e-5505dbb1c63c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 10:54:58.636895 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: DEBUG nova.api.openstack.wsgi [None req-0e4bab1b-e57c-4076-9da3-0442182e6eef tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] Calling method '.version_select at 0x7fe477669820>' {{(pid=119121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 10:54:58.660269 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO nova.api.openstack.requestlog [None req-0e4bab1b-e57c-4076-9da3-0442182e6eef tempest-TestVolumeBootPattern-619334190 tempest-TestVolumeBootPattern-619334190-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2074491997" status: 202 len: 0 microversion: 2.1 time: 0.028478 Jul 28 10:54:58.660980 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: [pid: 119121|app: 0|req: 565/1150] 10.222.0.25 () {58 vars in 1263 bytes} [Wed Jul 28 10:54:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2074491997 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 10:57:07.417284 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:57:07.417852 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:57:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:57:18.843728 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:57:18.844308 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:57:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:57:22.637008 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:57:22.637465 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: Wed Jul 28 10:57:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:57:29.025487 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:57:29.025944 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 10:57:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:57:32.441830 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:57:32.442499 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: Wed Jul 28 10:57:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 10:58:48.711678 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 10:58:48.712206 dv-cinder-800431-3-iscsi devstack@n-api.service[119120]: Wed Jul 28 10:58:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 11:00:27.434755 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 11:00:27.435388 dv-cinder-800431-3-iscsi devstack@n-api.service[119121]: Wed Jul 28 11:00:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!